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FOREWORD 

This  report  was  prepared  by  the  Infrared  Physics  Laboratory  of  Willow  Run 
Laboratories,  a  unit  of  The  University  of  Michigan's  Institute  of  Science  and  Tech¬ 
nology.  It  is  an  unscheduled  technical  report  submitted  under  Contract  DA-44-009- 
AMC-1494(T),  "Night  Vision  Aids  for  Counterinsurgency."  The  contract  is  funded 
by  the  Advanced  Research  Projects  Agency,  Washington,  D.  C.,  as  part  of  Project 
AGILE,  and  is  being  administered  by  the  Night  Vision  Laboratory,  U.  S.  Army  Mobility- 
Equipment  Research  and  Development  Center,  Fort  Belvoir,  Virginia.  While  the  tests 
described  herein  were  being  developed  (during  the  period  January  to  October  1967), 
the  ARPA-AGILE  project  monitor  was  Lt.  Col.  E.  I.  Golding,  USAF.  The  present 
project  monitor  is  Lt.  Col.  W.  Y.  Cole,  USAF. 

The  contract  supports  research  and  evaluation  that  will  help  in  the  design  and 
selection  of  night-vision  aids  for  use  by  counterinsurgent  military  forces,  particu¬ 
larly  those  of  governments  other  than  that  of  the  United  States.  The  program  is 
especially  concerned  with  improving  the  ability  to  predict  the  performance  of  a 
night-viewing  system  by  measuring  various  contributing  factors  such  as  the  viewing 
device,  operator  performance,  and  environment  (target,  background,  and  illumina¬ 
tion).  The  purpose  of  the  tests  described  herein  is  to  measure  the  visual  perfor¬ 
mance  of  individuals  and  to  establish  from  such  measurements  the  average  visual 
performance  of  a  potential  user  population.  To  this  end,  the  tests  are  now  being 
given  as  part  of  a  pilot  vision  survey  which  involves  a  sample  of  a  Middle  Eastern 
population.  This  work  has  been  subcontracted  by  The  University  of  Michigan  to  the 
American  University  of  Beirut,  Lebanon,  where  N.  A.  Haddad,  M.  D.,  and  B.  Faris, 

M.  D.,  are  the  Principal  Investigators.  The  work  began  on  1  January  1968  and  is  ex¬ 
pected  to  continue  through  at  least  31  December  1968. 
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ABSTRACT 

This  report  introduces  some  tests  of  night  and  day  vision  which,  though  devised 
for  a  special  purpose,  are  potentially  useful  in  a  much  wider  variety  of  applications. 
The  tests  are  mostly  of  binocular  visual  acuity  for  far  vision,  measured  either  dur¬ 
ing  the  course  of  dark  adaption  or  after  adaption  to  various  light  levels  has  been 
completed.  In  addition,  a  special  form  recognition  test  has  been  developed  to  in¬ 
vestigate  the  relationship  between  visual  acuity  data  and  the  visibility  of  a  "real- 
life"  shape,  namely,  the  silhouette  of  a  man. 

The  tests  are  implemented  via  specially  developed  slides  to  be  used  in  a  com- 
merical  vision  test  instrument.  The  latter  has  been  adapted  to  provide  a  range  of 
discrete  nighttime  and  daytime  light  levels  (through  the  use  of  neutral  density  fil¬ 
ters).  Unlike  the  slides  normally  provided  with  this  instrument,  those  specially  de¬ 
veloped  cover  a  wide  range  of  contrast  values.  Thus,  acuity  may  be  tested  over  a 
wide  contrast  range  at  each  of  the  nighttime  and  daytime  light  levels. 

While  the  tests  must  still  be  conducted  in  a  darkroom,  having  the  tests  imple¬ 
mented  as  they  are  enables  the  darkroom  to  be  considerably  smaller  and  more  prim¬ 
itive  than  would  otherwise  be  necessary,  and  the  tests  and  darkroom  can  even  be 
made  "portable.”  Basically,  this  results  from  the  fact  that  the  instrument  used  is 
a  closed  stereoscope  type  device  which  produces  the  far  vision  test  distance  (20  feet) 
by  otpical  means. 

The  report  covers  the  design  and  development  of  the  tests,  presents  some  re¬ 
sults  obtained  with  them,  and  gives  some  estimates  of  the  sample  sizes  required  to 
make  comparative  population  surveys,  the  purpose  for  which  the  tests  were  originally 
intended.  Detailed  equipment  operating  instructions  and  test  procedures  are  not  in¬ 
cluded,  however,  since  they  are  not  germane  to  the  discussion.  Instead,  these  are 
covered  in  another  document  designed  to  accompany  the  test  equipment. 
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SOME  TESTS  OF  NIGHT  AND  DAY  VISION 

1 

INTRODUCTION 

The  purpose  of  this  report  is  to  introduce  some  tests  of  night  and  day  vision  which,  though 
devised  by  The  University  of  Michigan  to  meet  a  special  need,  stand  on  their  own  as  being  po¬ 
tentially  useful  in  a  variety  of  applications,  both  military  and  civilian.  The  tests  are  mostly  of 
visual  acuity  for  far  vision,  measured  either  during  dark  adaptation  or  after  adaptation  to  vari¬ 
ous  light  levels  has  been  completed.  These  employ  a  conventional  type  of  acuity  target,  the 
Landolt  C,  as  the  test  stimulus.  In  addition,  a  special  form  recognition  test  has  also  been  de¬ 
veloped  to  investigate  the  relationship  between  (Landolt  C)  acuity  data  and  the  visibility  of  one 
"real-life"  shape,  namely,  the  silhouette  of  a  man.  All  the  tests  are  implemented  via  "slides" 
to  be  used  in  a  commercial  vision  test  instrument,  the  Bausch  and  Lomb  Modified  Ortho-rater, 
which  has  been  adapted  to  enable  testing  at  various  nighttime  and  daytime  light  levels.  (The 
latter  are  achieved  through  the  use  of  neutral  density  filters.)  Unlike  the  acuity  test  slides 
normally  provided  with  this  instrument,  the  specially  prepared  Landolt  C  slides  cover  a  number 
of  (negative)  contrasts  which  not  only  include  the  conventional  "black -on -white"  case  but  also 
range  almost  to  zero  contrast  (i.e.,  "white -on -white").  Besides  providing  a  more  comprehensive 
means  of  assessing  the  effect  of  those  physiological  mechanisms  which  limit  "contrast  percep¬ 
tion"  (as  distinguished  from  those  which  limit  "size  perception"),  the  use  of  a  variety  of  con¬ 
trasts  more  nearly  accords  with  what  is  encountered  in  everyday  seeing.  Also,  as  will  be  ex¬ 
plained  in  more  detail  later,  by  making  the  human  form  slides  of  the  same  contrast  as  the 
Landolt  C  acuity  slides,  an  unusual  test  of  a  form  recognition  principle  has  been  enabled. 

The  primary  reason  for  implementing  the  tests  via  a  Modified  Ortho-rater  was  to  take  ad¬ 
vantage  of  the  main  feature  this  instrument  is  designed  to  provide,  a  reduction  in  the  distance 
actually  needed  for  testing  far  vision  (which  entails  a  commensurate  reduction  in  target  sizes 
also.)*  By  using  stereoscope  optics  and  slides,  this  instrument  makes  the  test  objects  appear 
to  be  at  a  "far"  distance  of  20  feet  though  in  fact  they  are  only  about  1  foot  from  the  observer. 
Although  the  tests  must  still  be  conducted  in  a  darkroom,  the  latter  can  be  considerably  smaller 


*  For  reasons  which  will  be  made  evident  later,  only  the  ability  to  see  objects  at  far  vision 
distances  was  of  interest;  accordingly  the  tests  described  were  so  restricted.  This  incidentally 
permitted  cannibalizing  parts  from  the  near  vision  portion  of  the  Modified  Ortho-rater  for  use 
in  altering  its  light  source  to  achieve  the  range  of  light  levels  desired.  While  the  near  vision 
portion  of  the  machine  was  thus  rendered  inoperative,  this  need  not  have  been  the  case.  Indeed, 
the  near  vision  portion  could  also  have  been  adapted  to  achieve  a  range  of  light  levels,  had  such 
been  desired. 
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and  more  primitive  than  would  otherwise  be  necessary,  and  the  tests  and  darkroom  can  even  be 
made  "portable." 

Besides  the  special  test  slides  mentioned  above,  all  the  far  vision  test  slides  normally  pro¬ 
vided  with  the  Modified  Ortho-rater  can  still  be  used.  These  enable  tests  of  lateral  and  vertical 
phoria,  acuity  (with  checkerboard  type  targets),  depth  perception,  and  color  discrimination.  In 
addition,  all  those  slides  used  in  the  "Armed  Forces  Vision  Tester,"  a  more  elaborate  type  of 
"Ortho-rater,"  can  also  be  adapted  for  use  in  the  Modified  Ortho-rater.  (The  Armed  Forces 
Vision  Tester  was  not  used  as  the  basic  means  of  implementing  the  UM  tests  because  it  could 
not  be  as  readily  adapted  to  obtain  the  various  light  levels  as  could  the  Modified  Ortho-rater. 

The  same  is  true  for  other  commercial  instruments  similar  to  the  "Ortho-rater.")  Finally, 
slides  used  for  examining  drivers  license  applicants  and  even  school  children  are  also  available 
for  use  in  the  Modified  Ortho-rater. 

The  immediate  reason  for  developing  the  tests  was  to  supply  the  means  for  conducting  a 
vision  survey  and  comparison  of  the  U.  S.  and  at  least  one  other  world  population,  namely,  that 
of  the  Middle  East.  Tkis  in  turn  was  to  obtain  information  in  support  of  a  much  broader  UM 
study  on  night  vision  aids.  More  specifically,  it  was  thought  that  significant  differences  might 
exist  in  the  vision  cf  various  world  populations  which  would  at  least  be  reflected  in  their  per¬ 
formance  with  night  vision  aids  and  which  might  even  necessitate  special  designs  for  each.  The 
idea  that  various  populations  have  different  visual  characteristics  was  based  in  part  on  anecdotal 
evidence,  but  more  importantly  on  awareness  of  such  things  as  the  varying  degrees  to  which 
populations  experience  dietary  deficiencies  and  diseases  which  can  affect  their  vision. 

To  explore  the  concept  just  outlined  with  regard  to  the  Middle  East  population,  a  pilot  "Vision 
Study  Program"  has  been  established  jointly  between  The  University  of  Michigan  and  the  Ameri¬ 
can  University  of  Beirut,  Lebanon.  Though  some  reference  will  be  made  to  this  program  in  the 
following  discussion,  it  is  not  the  purpose  of  this  document  to  describe  it  in  detail.  Rather,  this 
document  is  more  to  explain  how  the  purpose  of  such  a  program,  the  night  vision  aids  application, 
led  to  development  of  the  UM  tests,  and  to  indicate  how  the  tests  might  be  used  in  other  studies 
involving  other  applications. 

The  basic  principles  underlying  the  tests  are  discussed  next,  in  section  2.  Following  this, 
section  3  tells  how  these  principles  were  translated  into  specific  tests  and  reviews  the  major 
considerations  involved  in  their  implementation.  Section  4  presents  some  results  which  have 
been  obtained  at  UM  and  compares  these  with  previous  work  which  guided  the  development  of 
the  tests.  Some  preliminary  AUB  results  are  also  presented  in  section  4  and  these  are  com¬ 
pared  with  the  UM  results.  Pursuant  to  using  the  tests  in  other  studies,  section  5  presents 
estimates  of  the  sample  sizes  needed  to  determine  whether  various  "population"  differences 
exist.  Finally,  in  section  6,  some  applications  of  the  tests  other  than  that  connected  with  night 
vision  aids  are  discussed. 
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2 

PRINCIPLES  UNDERLYING  THE  TESTS 

2.1.  VISUAL  ACUITY 

The  basic  principle  on  which  visual  acuity  tests  are  founded  is,  the  smaller  the  objects  one 
can  see,  the  better  is  one's  vision.  Such  tests  measure  minimum  visual  angle,*  which  depends 
on  the  contrast  between  the  test  object(s)  and  the  background,  the  general  light  level  (usually 
specified  in  terms  of  the  background  light  level),  and  many  other  factors.  A  typical  wall-chart 
vision  test  displays  only  black  silhouette  targets  against  a  uniform  white  background  and  involves 
only  one  light  level,  but  this  usually  reflects  only  the  convenience  and  simplicity  of  making  up 
such  a  test:  the  test  objects  need  not  be  silhouettes,  the  background  and  test  objects  could  just 
as  well  be  in  shades  of  grey,  and  the  background  could  be  darker  than  the  objects  instead  of 

lighter.  Moreover,  any  two  of  the  above  parameters — visual  angle,  contrast,  and  light  level _ 

may  be  fixed  and  the  third  used  as  the  dependent  test  variable  to  generate  a  threshold  visibility 
suiface  in  the  three-dimensional  'seeing  space"  defined  by  these  parameters;  this  surface 
would  divide  the  space  into  see'  and  "no  see"  regions.  Such  tests  are  properly  called  visual 
acuity  tests  only  if  the  visual  angle  is  the  dependent  variable.  If,  instead,  contrast  were  varied, 
then  the  terms  "liminal  brightness  increment"  or  "contrast  threshold"  might  more  properly  be 
used  to  indicate  the  nature  of  the  test.  (There  seems  to  be  no  special  terminology  for  the  use 
of  light  levels  as  the  dependent  test  variable.)  No  matter  which  parameter  is  the  dependent 
variable,  however,  the  same  threshold  surface  would  presumably  result.  Thus,  to  speak  of 
minimum  visual  angle  would  logically  be  no  different  than  to  speak  of  threshold  contrast  or 
threshold  brightness.  (This  statement  must  be  qualified  where  the  visual  angle  is  such  that 
only  one  retinal  receptor  is  excited  or  where  the  large-area  contrast  approaches  a  certain  low 
value  established  by  the  physiology  of  the  eye;  nevertheless,  it  remains  a  useful  generalization 
and  is  appropriate  for  the  discussion  which  follows.)  It  is  in  this  extended  sense  that  the  tests 
measure  visual  acuity;  i.e.,  they  employ  visual  angle  as  the  dependent  variable  to  generate  a 
threshold  visibility  surface  over  a  wide  range  of  contrasts  and  light  levels. 

The  fact  that  the  angle  measured  is  a  minimum  angle  is  basically  the  result  of  deliberately 
designing  or  selecting  each  test  object  used  so  that  it  has  some  critical  feature  which  must  be 
"just  seen"  before  the  object  itself  can  be  "just  seen."  If  all  acuity  tests  made  use  of  objects 

jfc 

Visual  angle  is  defined  as  the  angle  (usually  in  minutes  of  arc)  subtended  at  the  eye  bv 
some  linear  object  dimension.  For  objects  displayed  at  some  fixed  distance  (as  in  a  typical 
acuity  test),  the  minimum  visual  angle  is  directly  proportional  to  the  minimum  size  one  can  see 
and  thus  serves  as  an  equivalent  measure  of  size.  Actually,  the  technical  definition  of  "visual 
acuity  is  the  reciprocal  of  the  minimum  visual  angle.  In  any  case,  the  distance  involved  is  im¬ 
portant.  Disregarding  the  effect  of  the  intervening  medium  on  object/background  contrast, 
minimum  visual  angle  is  essentially  constant  for  distances  of  20  feet  or  more  (far  vision)  but 
not  necessarily  so  for  lesser  distances  because  of  differences  in  the  degree  of  accommodation 
and  convergence. 
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containing  the  same  critical  feature,  then  the  same  results  would  obtain  regardless  of  which 
test  was  used;  however,  this  is  generally  not  the  case,  and  it  does  not  appear  to  be  a  simple 
matter  to  make  it  so.  The  common  wall-chart  test  in  which  a  variety  of  letters  must  be  read 
is  a  case  in  point.  Though  all  letters  of  the  same  size  presumably  are  constructed  to  be  equally 
visible,  some  are  slightly  more  difficult  to  read  than  others.  Moreover,  there  is  evidence  that 
such  discrepancies  are  not  constant  but  depend  at  least  on  light  level  [1 J .  The  fact  that  these 
discrepancies  exist,  however,  does  not  invalidate  the  idea  that  just  seeing  objects  of  this  type  is 
equivalent  to  just  seeing  some  critical  feature  they  possess;  it  simply  emphasizes  the  improba  ¬ 
bility  of  being  able  to  tell  on  an  a  priori  basis  just  how  critical  any  one  feature  is,  even  though 
it  is  known  (by  design)  that  the  feature  must  in  some  sense  be  critical.  As  far  as  acuity  tests 
are  concerned,  self-contained  discrepancies  can  obviously  be  removed  by  designing  a  test  which 
uses  a  single  type  of  test  object,  and  many  such  tests  have  been  developed  which  do  just  this. 
Indeed,  the  UM  tests  were  deliberately  chosen  to  be  of  this  type  and  for  just  this  reason.  Even 
so,  the  likelihood  of  establishing  precisely  how  critical  an  object  feature  is  has  important  rami¬ 
fications  not  only  in  comparing  the  results  of  acuity  tests  but  also  in  the  more  realistic  visibility 
problems  to  be  considered  next. 

2.2.  REAL-LIFE  VISIBILITY 

If  one  were  to  apply  classical  silhouette -target  visual  acuity  data  to  predicting  the  visibility 
of  objects  in  natural  scenes,  then  at  least  four  additional  discrepancies  would  be  encountered: 

(1)  At  light  levels  high  enough  for  color  vision,  differences  in  color  between  objects  and 
backgrounds  would  obviously  come  into  play  and  might  be  the  sole  determinant  of  object  visibility. 
This  is  not  accounted  for  in  the  classical  version  of  visual  acuity  which  deals  only  with  achro¬ 
matic  targets  and  backgrounds. 

(2)  Real-life  objects  would  not  usually  appear  "uniform"  (i.e.,  would  not  be  silhouettes). 

(3)  Real-life  backgrounds  would  not  usually  appear  uniform. 

(4)  Even  if  the  objects  and  backgrounds  were  uniform,  it  still  might  be  virtually  impossible 
to  know,  a  priori,  which  features  of  the  objects  were  likely  to  be  critical. 

Because  of  the  above,  it  is  true  that,  in  general,  there  is  no  simple  relation  between  the 
classical  version  of  visual  acuity  and  the  "ordinary  seeing  ability"  it  is  often  assumed  to  de¬ 
scribe;  however,  it  is  also  true  that,  were  it  not  for  items  2  and  3,  at  least  an  ad  hoc  relation 
could  be  established  which  would  at  most  require  a  straightforward  e.  ision  of  the  classical 
approach  to  include  color/  For  the  achromatic  case,  this  would  result  from  the  ability  simply 
to  equate  the  threshold  visibility  of  some  acuity  target  and  of  a  real-life  object's  silhouette  for 
the  same  background  luminance  and  contrast  conditions.  For  the  chromatic  case,  the  acuity 

* 

If,  contrary  to  2  and  3,  the  objects  were  silhouettes  and  the  backgrounds  uniform,  then  only 
two  colors  could  be  involved,  one  for  the  target  and  one  for  the  background. 
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target  and  silhouette  would  have  to  be  of  the  same  color  as  well,  as  would  their  respective  back¬ 
grounds.  In  either  case,  from  the  known  distance  at  which  the  real-life  object's  silhouette  was 
presented  as  well  as  from  the  known  visual  angle  subtended  by  the  critical  dimension  of  the 
acuity  target,  a  critical  dimension  could  be  computed  for  the  ordinary  object.  This  dimension 
would  then  be  an  ad  hoc  property  of  the  object  seeing  task  for  the  particular  contrast,  back¬ 
ground  luminance,  and  color  conditions  involved  even  though  there  might  well  be  no  obvious  fea¬ 
ture  of  the  object  itself  to  which  the  dimension  could  be  sensibly  referred. 

If  the  critical  dimension  so  determined  were  then  proved  to  be  independent  of  contrast  and 
background  luminance,  an  invariant  property  of  the  object  seeing  task  would  have  been  estab¬ 
lished.  Further,  if  this  principle  of  invariance  were  truly  valid  for  all  such  tasks,  then  any  ad 
hoc  critical  dimension  would  be  an  invariant,  and  it  would  only  be  necessary  to  determine  such 
a  dimension  for  one  set  of  contrast  and  luminance  conditions.  Once  this  was  achieved  for 
various  object  seeing  tasks,  the  acuity  data  could  be  used  as  a  standard  to  predict  visibility  un¬ 
der  different  parametric  conditions,  or  to  assess  the  practical  effect  of  individual  differences 
in  seeing  ability,  or  both.  While  objects  ether  than  acuity  targets  could  be  used,  the  fact  that 
acuity  targets  have  critical  features  that  can  easily  be  identified  makes  them  most  attractive 
for  this  purpose.  Put  another  way,  to  be  able  to  determine  an  unknown  critical  dimension  by 
using  one  which  is  known  is  especially  satisfying.  Because  the  known  critical  dimension  of  an 
acuity  target  is  subject  to  the  vagaries  described  above,  however,  the  critical  dimension  of  the 
object  would  not  be  independent  of  the  kind  of  acuity  target  used  in  its  definition. 

2.3.  FORM  RECOGNITION 

Although  invariance  with  respect  to  contrast  and  background  luminance  seems  never  to  have 
been  explored  for  the  chromatic  case,  previous  achromatic -case  experiments  indicate  that  ad 
hoc  critical  dimensions  may  indeed  be  independent  of  these  parameters.  Because  only  the 
achromatic  case  is  of  particular  importance  in  the  night-vision-aids  context,  the  UM  form- 
recognition  tests  were  restricted  to  being  of  this  type  and  were  developed  in  part  to  see  if  a 
sounder  basis  for  the  invariance  could  be  established  for  at  least  one  silhouette  of  interest,  that 
of  a  man. 

Another  reason  for  developing  the  form-recognition  tests  was  the  following:  Since  seeing 
even  silhouettes  of  ordinary  forms  involves  perceptual  and  cognitive  processes  of  a  higher  or¬ 
der  than  those  used  in  seeing  the  more  primitive  acuity  targets,  it  seemed  possible  that  differ¬ 
ences  in  individual  ability  or  capacity  for  such  higher-order  processes  might  be  revealed  from 
such  tests;  i.e,,  individuals  with  the  same  acuity  might  have  to  see  different  critical  dimensions 
for  the  same  object  seeing  task.  As  will  be  explained  later,  the  attempt  to  achieve  a  relatively 
pure  measure  of  such  effects  partly  accounts  for  the  forms  used  in  the  UM  tests.  The  extent 
to  which  higher-order  processes  are  involved  may  be  better  appreciated  by  considering  how  the 
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nature  of  the  seeing  task  determines  the  critical  dimension  for  a  given  object.  Consider,  for 
example,  the  case  of  a  silhouette  of  a  man.  If  an  observer  had  only  to  sense  the  presence  of 
this  form  as  something  in  one  of  a  number  of  space-time  locations,  with  nothing  in  the  other  lo¬ 
cations,  then  it  is  easy  to  imagine  that  a  comparatively  large  critical  dimension  would  result. 
(Though  the  observer  might  be  able  to  see  more  than  "something,”  this  would  be  irrelevant.) 

On  the  other  hand,  if  an  observer  had  to  recognize  a  silhouette  of  a  man  amidst  a  variety  of 
somewhat  similar  forms  (as  in  the  UM  test),  then  a  smaller  critical  dimension  would  be  ex¬ 
pected.  The  more  similar  the  other  forms  were  to  the  man,  the  more  discriminating  the 
observer  would  have  to  be,  and  the  smaller  the  expected  critical  dimension.  For  objects 
at  a  fixed  distance,  the  visual  angle  required  would,  of  course,  become  smaller  as  the  discrimi¬ 
nations  grew  more  difficult  and  would  thus  serve  as  a  measure  of  the  degree  of  difficulty  of  the 
task.  However,  different  tasks  could  be  of  equivalent  difficulty  provided  the  objects  involved 
were  placed  at  different  ranges,  since  it  is  the  critical  dimension  and  not  the  degree  of  diffi¬ 
culty  that  is  defined  by  the  task. 

2.4.  NIGHT- VISION  AIDS  AND  THE  SINE -WAVE-RESPONSE  APPROACH 

Thus  far,  the  discussion  has  been  concerned  only  with  the  classical  concept  of  visual  acuity 
and  what  can  be  done  with  it.  Despite  some  lingering  uncertainties,  it  has  been  suggested  that 
at  least  a  primitive  connection  can  be  established  between  classical  acuity  data  and  "reality," 
in  terms  of  the  critical  dimensions  of  real-life  silhouettes.  Assuming  this  to  be  true,  what  re¬ 
mains  to  be  established  is  the  appropriateness  of  the  approach  to  the  basic  purpose  ror  which 
the  UM  tests  were  intended:  obtaining  data  useful  for  predicting  operator  performance  with 
night-vision  aids.  For  this  purpose,  it  is  necessary  to  consider  the  appearance  of  scenes  when 
viewed  with  night-vision  aids  and  Uie  way  such  devices  operate  on  the  scenes.  (This  subject  will 
lead  to  a  discussion  of  a  modern  version  of  visual  acuity,  the  sine -wave -response  approach.) 

The  night-vision  aids  of  primary  concern  are  those  which  provide  a  real-time  viewing  capa¬ 
bility.  Besides  ordinary  optical  aids  such  as  binoculars  or  telescopes,  these  include  electro- 
optical  aids  such  as  television  systems  (which  allow  remote  viewing)  and  direct-view  image- 
intensifier  devices.  Whereas  optical  aids  impro\e  object  visibility  essentially  in  only  one  way, 
by  optical  magnification,  electro -optical  aids  can  also  raise  the  apparent  scene  luminance  by 
electronic  amplification  and  may  amplify  the  contrast  as  well,*  Color  imagery  is  also  possible 

with  electro -optical  aids,  but  the  added  complexity  and  cost  of  providing  this  feature  generally 

* 

For  image-intensifier  devices,  this  would  result  from  deliberately  selecting  an  input  spec¬ 
tral  sensitivity  such  that  for  given  target  and  background  spectral  characteristics,  the  apparent 
contrast  of  the  target  would  be  increased.  Besides  the  possibility  of  employing  this  approach, 
television  systems  can  amplify  contrast  electronically.  In  either  case,  however,  the  input  spec¬ 
tral  sensitivity  coupled  with  the  spectral  characteristics  of  the  scenes  would  determine  the  in¬ 
put  contrast  to  the  device,  and  this,  by  accident  or  design,  might  not  be  the  same  as  the  direct 
visual  contrast. 
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has  been  regarded  as  unjustified  for  most  military  needs;  moreover,  at  low  nocturnal  light  levels 
(e.g.,  starlight),  the  optical  filters  used  at  the  input  of  electro-optical  aids  to  sample  colors  reduce 
the  input  signal  to  such  an  extent  that  color  imagery  is  marginal  if  not  impossible  for  state-of-the- 
art  detectors.  This  subject  has  been  discussed  by  Paprockiand  Miller  [2]  for  the  case  of  image  in- 
tensifiers  aids.  They  point  out  that  such  devices  can  now  be  made  to  produce  colors  at  intermediate 
moonlight  levels.  For  ordinary  optical  aids,  natural  nocturnal  light  levels  are  not  in  themselves  high 
enough  to  enable  a  viewer  to  see  colors.,  but  the  active  use  of  supplementary  artificial  illumina¬ 
tion  is  often  undesirable,  at  least  in  the  military  context.  Due  to  the  kinds  of  target-seeing 
tasks  of  greatest  military  importance,  most  targets  would  be  at  a  far-vision  distance  when  seen 
and  would  naturally  appear  to  be  so  to  an  observer  using  an  optical  aid.  While  the  latter  is 
usually  not  the  case  for  television  systems  and  need  not  be  the  case  for  image-intensifier  de¬ 
vices,  both  may  be  equipped  with  viewing  optics  to  make  it  so,  and,  indeed,  such  is  usually  the 
case  for  image-intensifier  devices,  which  are  of  greatest  interest  to  this  study.  (If  television 
systems  do  not  make  objects  appear  at  their  true  far  distances,  neither  do  they  make  them  ap¬ 
pear  at  what  is  conventionally  used  in  acuity  testing  as  a  near-vision  distance,  i.e.,  a  normal 
reading  distance;  in  fact,  the  acuity  tests  most  appropriate  to  viewing  television  under  conditions 
similar  to  those  in  the  home  would  be  of  the  far-vision  type.) 


Although  these  features  do  not  cover  every  conceivable  type  of  night-vision  aid  or  every 
viewing  situation,  they  do  apply  to  the  vast  majority  of  cases.  Further,  they  readily  translate 
into  gross  requirements  for  acuity  testing:  that  the  scenes  be  achromatic;  that  they  require  the 
use  of  far  vision;  and  that  a  range  of  light  levels,  contrasts,  and  visual  angles  be  covered.  With 
regard  to  light  levels,  it  should  be  emphasized  again  that  whereas  optical  aids  essentially  do 
not  affect  the  apparent  scene  luminance,  electro-optical  aids  are  capable  of  raising  the  apparent 
luminance  to  daytime  values;  thus,  to  account  for  electro-optical  as  well  as  optical  aids,  acuity 
at  daytime  as  well  as  at  nighttime  light  levels  must  be  considered. 


We  now  turn  to  the  areas  where  the  use  of  night-vision  aids  conflicts  with  the  conventional 
acuity-test  approach.  When  a  silhouette  target  is  viewed  through  a  night-vision  aid,  it  appears 
no  longer  to  be  a  silhouette,  because  all  night-vision  devices  characteristically  introduce  a  cer 
tain  amount  of  blurring;  the  edges  of  the  form  appear  less  sharp,  or  separable  parts  of  the 
form  appear  to  be  merged,  or  both.  This  is  in  addition  to  any  geometric  distortion  or  lack  of 
uniform  response.  The  visibility  of  conventional  acuity  test  silhouettes,  therefore,  cannot  be 
exactly  matched  to  the  visibility  of  the  blurred  and  possibly  nonuniform  or  distorted  images  of 
such  targets,  and  the  use  of  the  conventional  data  to  predict  operator  performance  with  a  night- 
vision  aid  would  be  similarly  inexact.  Although  geometric  distortions  can  be  eliminated  by 
design,  and  lack  of  uniformity  might  have  a  negligible  effect,  there  would  still  be  no  solu¬ 
tion  to  the  problem  of  blurring  unless  one  additional  condition  were  satisfied:  If  the  device 
were  linear,  i.e.,  if  the  overall  output  luminance  were  linearly  related  to  input  radiance  (or 
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luminance),  then  the  sine-wave-response  approach  could  be  employed.  This  approach  is  based 
on  the  fact  that  a  spatial  luminance  distribution,  modulated  along  some  direction  in  a  sinusoidal 
manner,  would  be  imaged  as  such;  i.e.,  its  contrast  might  be  diminished  and  some  spatial 
phase -shifting  encountered,  but  its  image  would  still  be  a  sine -wave  pattern.  Thus,  acuity  data 
derived  from  spatial  sine-wave  patterns  could  be  exactly  matched  to  the  output  images  of  such 
patterns.  (If  the  sine -wave  pattern  were  finite  in  extent  and  its  boundaries  were  within  the 
field  of  view,  then  each  180°  phase  shift  would  also  result  in  the  loss  of  one  fringe.  This  could 
be  important  to  the  comparison  with  acuity  data  if  only  a  few  fringes  remained.)  Further,  since 
many  optical  and  electro -optical  aids  are  linear,  this  solution  could,  at  least  in  principle,  have 
widespread  applicability. 

Given  that  the  acuity  problem  can  thus  be  solved,  what  of  the  visibility  of  real-life  shapes? 
For  unaided*  (i.e.,  well-corrected)  vision,  sine -wave -pattern  acuity  might  be  substituted  for 
any  of  the  classical  types  of  acuity  data  in  deriving  critical  dimensions  for  silhouette  forms, 
but  what  of  aided  vision  where  such  shapes  are  distorted?  In  principle,  these  questions  could 
be  answered  as  follows.  A  device  may  be  completely  characterized  (over  its  linear  operating 
range)  by  its  ability  to  pass  spatial  sine- wave  patterns.  This  may  be  done  in  terms  of  an  op¬ 
tical  transfer  function,  which  indicates  how  both  the  contrast  and  the  phase  of  spatial  sine  waves  of 
any  frequency  are  affected  by  the  device.  (That  part  of  the  optical  transfer  function  which  gives  con¬ 
trast  information  alone  is  called  the  modulation  transfer  function.)  If,  as  is  often  the  case,  there 
were  no  phase  shifting,  then  the  transfer  function  could  be  compounded  with  sine-wave  acuity  data 
in  such  a  way  as  to  unambiguous^  indicate  the  object-space  contrast  required  to  see  sine  waves  of 
various  frequencies,  i.e.,  to  produce  a  kind  of  aided  visual  acuity  data.  This,  together  with  the 
fact  that  the  luminance  distribution  representing  an  object  may  be  decomposed  by  Fourier 
analysis  into  an  entirely  equivalent  spatial  sine -wave -pattern  content,  means  that  the  results 
would  be  the  same  as  if  unaided  acuity  were  changed.  Thus,  aided  visual  acuity  data  could  be 
coupled  with  the  critical  dimension  of  a  silhouetted  form  (determined  from  sine  wave  acuity) 
to  predict  the  visibility  of  that  form  under  changing  parametric  conditions. 

The  spatial  sine -wave-pattern  approach  was  strongly  considered  as  the  means  for  per¬ 
forming  the  tests.  Though  it  was  rejected  principally  because  of  the  practical  difficulties  in¬ 
volved  in  making  such  patterns,  there  were  a  number  of  other  reasons  as  well.  First,  the  fact 
remains  that  some  devices  are  not  linear.  Moreover,  those  that  are  often  exhibit  nonuniform 
response  and  geometric  distortion  as  well  as  phase  shifts.  In  addition  to  such  loss  of  generality 
due  to  device  "perturbations,"  serious  questions  can  be  raised  about  the  way  sine-wave  acuity 
tests  are  conducted.  Specifically,  while  the  conventional  "method-of-limits"  approach  to  ob¬ 
taining  sine-wave  acuity  may  be  satisfactory  for  some  laboratory  work,  it  does  not  seem  ap- 

*The  term  "aided"  does  not  refer  to  the  wearing  of  eyeglasses  but  rather  to  the  use  of 
optical  or  electro -optical  aids. 
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ierences  would  be  of  interest  and  that  therefore  the  conventional 
acuity  test  employing  silhouetted  forms  would  be  adequate. 

2.5.  DYNAMIC  VISUAL  ACUITY  AND  OBSERVATION  TIME 
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IMPLEMENTATION  OF  THE  TESTS 

3.1.  SUMMARY 

Having  decided  that  a  conventional  acuity  test  should  be  used,  there  remained  the  „  h 

lems  of  selecting  the  type  of  tareet  anH  m  ,  Prob- 

_  ype  target  and  the  procedures  and  equipment  for  implementing  the 

he  knows*  ?^irS£^i3?r  'he  °bSerVfr  t0  te»  U  he  can  sue  something 
out  a  sine-wave  pattern  from  several  alternaUves'  min'h11'1  be  t0  requlre  th<"  observer  to  pick 
Checkerboard  from  several  other  gr^s^^n 
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tests.  Consistent  with  the  goal  of  obtaining  data  for  predicting  operator  performance  with  night 
vision  aids,  the  range  of  light  levels  which  might  profitably  be  covered  had  first  to  be  estab¬ 
lished.  By  referring  to  published  data  on  natural  nocturnal  illunr ration  levels,  the  reflectivity 
of  natural  backgrounds,  and  the  luminance  gains  obtainable  for  various  types  of  electro-optical 
aids,  representative  values  of  apparent  scene  luminance  were  deduced  for  electro-optical  as 
well  as  optical  aids.  These  values  ranged  over  7  orders  of  magnitude  from  a  low  of  ~10"5 
mL,  corresponding  to  the  optically  aided  (or  unaided)  viewing  of  green  grass  in  starlight,  to  a 
high  of  ~  10  mL,  corresponding  to  the  electro -optically  aided  viewing  of  snow  in  the  light  of  a 
full  moon.  The  latter  assumes  a  representative  maxim  >  luminance  gain  of  ~  104  for  electro- 
optical  aids  based  on  what  can  be  done  with  certain  imagc-intensifier  devices.  With  this 
luminance  range  as  a  guide,  the  next  step  was  to  determine  how  much  of  this  range  had  been 
covered  by  conventional  acuity  tests  and  of  what  these  tests  consisted.  While  it  was  found  that 
tests  had  been  performed  over  portions  of  the  range  using  a  variety  of  conventional  targets,  it 
was  also  found  that  these  tests  usually  involved  only  one  (high)  contrast,  which  may  be  desig¬ 
nated  black-on-white.  Two  well-known  exceptions,  however,  are  the  tests  by  Blackwell  [4,  5] 
and  by  Conner  and  Ganoung  [6]  and  Cobb  and  Moss  [7,  8J.  Whereas  Blackwell  made  use  of  disk¬ 
shaped  test  targets,  Conner  and  Ganoung  used  Landolt  C  targets  at  low  light-levels  to  "extend" 
the  acuity  measurements  which  Cobb  and  Moss  had  made  at  high  light-levels  with  two-bar  pat¬ 
terns.  Both  of  these  tests  include  the  black-on-white  case,  but  they  also  cover  lower  contrast 
values,  ranging  almost  to  zero.  In  addition,  Blackwell  [4]  shows  that  for  the  same  background 
luminance  and  disk  size,  disks  in  negative  contrast  (dark-on-light  background)  and  disks  in 
positive  contrast  (light -on-dark  background)  are  about  equally  visible.*  A  similar  conclusion 
for  Landolt  C  targets  was  reported  by  Vos,  Lazet,  and  Bouman  [9].  (Their  tests  also  covered 
a  broad  luminance  and  contrast  range  and  would  also  have  provided  a  useful  precedent  except 
for  ambiguities  in  their  report  in  connection  with  specifying  the  luminances  used.) 


Since  it  had  always  been  intended  that  more  than  one  contrast  be  included  in  the  tests  (this 
was  first  suggested  by  Dr.  Haddad  in  his  July  1966  Proposal),  the  next  step  was  to  decide  which 
of  the  above  precedents  to  use,  i.e.,  whether  to  employ  disk  or  Landolt  C  targets.  This  is  not 
to  say  that  some  other  conventional  approach  could  not  have  been  considered,  but  rather  that 
there  was  no  compelling  reason  to  do  so.  Both  approaches  seemed  quite  compatible  with  one 
implicit  requirement  of  the  AUB  tests  — that  they  be  free  of  literacy  and  linguistic  barriers 
(e.g.,  that  they  not  use  letters  of  the  alphabet).  Moreover,  it  was  evident  that  an  equally  valid 
test  could  be  given  with  either  approach;  both  use  an  identical  procedure  in  which  less  than  an 
even-chance  opportunity  for  success  can  be  associated  with  every  correct  test  response.  For 


„  oi  fThf-eqU1ValenCe l.°f  positive  and  negative  contrast  seems  likely  to  be  subiect  to  the  same 
qualifications  as  mentioned  in  connection  with  visibility  threshold  surfaces  (i  e  more  than  one 

a  ""'°1''ed-  etc');  however.  f°r  -XMt  practical  situations',’ this  remains 
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the  Landolt  C  target,  this  means  that  the  subject  would  have  to  tell  the  actual  location  of  its 
gap  when  the  gap  has  been  randomly  placed  in  one  of  more  than  two  fixed  locations  (e.g.,  top, 
bottom,  right,  or  left).  Since  the  ring  portion  of  the  C  is,  by  design,  more  visible  than  its  gap, 
the  Landolt  C  essentially  provides  its  own  self-contained  reference  frame  for  this  purpose. 

On  the  other  hand,  a  separate  (more  visible)  reference  frame  must  be  provided  for  the  disk  to 
create  the  same  kind  of  test  situation.  Because  of  practical  implementation  problems  and  some 
uncertainties  associated  with  this  separate  reference  frame,  the  disk  approach  was  ultimately 
eliminated. 

To  know  that  a  test  score  represents  the  best  an  observer  can  do  requires  that  the  test 
procedure  provide  some  means  of  detecting  "deceptions,"  whether  they  are  accidental  or 
deliberate,  and  whether  they  lead  to  better  or  worse  results  than  those  representing  an  ob¬ 
server's  true  abilities.  Deceptively  good  results  can  be  guarded  against  by  adopting  a  proce¬ 
dure  in  which  there  is  less  than  an  even-chance  opportunity  for  making  a  correct  response. 
There  is  no  procedure  based  on  the  design  of  the  target  for  guarding  against  deceptively  bad 
results.  Whereas  the  detection  of  deceptively  good  results  is  often  all  that  is  considered  im¬ 
portant  (e.g.,  in  drivers  license  or  job  applicant  tests),  this  need  not  be  the  case,  and  the  pro¬ 
vision  of  both  kinds  of  safeguards  for  the  tests  was  initially  a  matter  of  some  concern.  In  de¬ 
ciding  on  such  matters,  however,  consideration  had  to  be  given  to  the  fact  that,  even  without 
any  safeguards  (as,  for  example,  with  the  method  of  limits),  it  has  frequently  been  demon¬ 
strated  that  repeatable  results  can  be  obtained  [7,  8].  Though  such  results  do  not  necessarily 
represent  the  best  that  can  be  done,  neither  do  they  represent  the  worst,  and,  in  any  event, 
they  provide  one  means  of  making  population  comparisons.  To  be  sure,  there  would  be  no  way 
of  proving  that  those  results  obtained  with  [4,  6]  and  those  obtained  without  safeguards  repre¬ 
sent  the  same  kinds  of  response  for  each  of  the  populations  being  compared.  Nevertheless,  as 
long  as  there  is  nothing  about  the  test  situation  to  motivate  deliberate  deception,  it  would  seem 
unlikely  that  deception  would  be  prevalent.  So-called  objective  techniques,  by  means  of  which 
deceptively  bad  results  (as  well  as  deceptively  good  results)  may  presumably  be  detected, 
have  apparently  been  restricted  to  the  use  cf  involuntary  physiological  responses  (e.g.,  opto¬ 
kinetic  nystagmus  and  electrical  signals  from  the  cortex)  as  indicators  of  subjective  perception. 
(The  use  of  hypnosis  or  "truth  serum"  might  also  be  contemplated  but  would  seem  manifestly 
unsuitable  for  survey  testing.)  Though  consideration  was  given  to  using  involuntary  physio¬ 
logical  responses,  this  was  rejected  as  being  an  unnecessary  complication.  The  procedure 
finally  selected  was  the  type  which,  by  the  nature  of  the  stimulus  used,  guards  against  decep¬ 
tively  good  results;  it  was  chosen  over  the  method-of-limits  approach  because  it  extended  the 
1  otential  applicability  of  the  tests  to  those  situations  where  such  a  safeguard  would  be  impor¬ 
tant. 
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3.2.  SELECTION  OF  THE  MODIFIED  ORTHO-RATER 

It  was  immediately  apparent  that  to  use  an  actual  far-vision-test  distance  (e.g.,  20  ft)  and 
to  conduct  the  tests  over  the  range  of  light  levels  being  considered  would  require  a  specially 
designed,  carefully  controlled,  and  relatively  large  darkroom  facility.  It  did  not  seem  likely 
that  such  a  facility  could  be  easily  acquired  for  the  AUB  case  or  for  any  other.  Fortunately, 
rather  than  having  to  face  this  problem,  an  ideal  alternative  seemed  at  hand.  There  are  a 
number  of  instruments  available  for  testing  daytime  acuity  which  reduce  the  far-vision-test 
distance  by  employing  the  optical  stereoscope  principle— stereoscope  optics  and  slides 
make  the  test  objects  appear  to  be  at  an  appropriate  far  distance  (e.g.,  20  ft)  while  a  smaller 
observer-target  separation  (e.g.,  1  ft)  is  maintained  — and  while  none  of  these  instruments 
come  ready-made  with  provisions  for  testing  acuity  over  various  contrasts  and  light  levels,  it 
was  clear  that  any  one  could  probably  be  so  adapted.  In  deciding  which  of  the  instruments  to 
select,  consideration  was  given  to  the  best  method  of  changing  the  light  levels.  While  the  light 
output  of  the  bulb  used  to  back-light  the  slides  could  have  been  varied  directly  by  changing  the 
voltage  applied  to  the  bulb,  this  would  also  have  changed  the  color  of  the  light  and  would  have 
been  hard  to  control  because  of  the  highly  nonlinear  dependence  of  bulb  luminance  on  applied 
voltage.  A  better  and  more  natural  solution  was  to  use  neutral-density  filters  to  attenuate  the 
light  reaching  the  slides  from  the  bulb  (or,  more  correctly,  from  the  intervening  diffusing 
plate).  The  instrument  which  most  readily  lent  itself  to  this  approach  was  the  Bausch  and 
Lomb  Modified  Ortho-rater.  Whereas  other  instruments  effectively  limit  the  number  of  slides 
which  could  be  used  (by  putting  them  on  a  rotating  drum  around  the  bulb  diffusing  plate),  the 
Modified  Ortho-rater  features  manual  insertion  of  each  slide  and  thus  permits  showing  any 
number  of  slides  without  disassembling  the  instrument.  Since  it  was  evident  that  the  same 
feature  could  easily  be  provided  for  the  neutral-density  filters  (because  of  the  instrument's 
box-like  structure),  and  since  the  number  of  new  slides  and  filters  needed  was  initially  an  un¬ 
known  factor,  the  Modified  Ortho-rater  seemed  a  clear  choice.*  It  was  clear  also  that  new 
slides  would  be  needed.  Even  if  the  tests  had  been  arbitrarily  restricted  to  the  single  black- 
on-white  contrast  level  of  the  acuity  slides  provided  with  the  instrument,  these  would  have 
covered  too  few  visual  angles  over  too  small  a  range  to  have  been  of  much  use.  Moreover,  it 
was  evident  that  the  best  solution  to  the  problem  of  how  to  obtain  a  range  of  contrasts  was 
simply  to  make  slides  with  targets  at  various  contrasts.  While  consideration  was  also  given 
to  using  the  well-known  veiling  luminance  technique  for  obtaining  reduced  contrasts,  imple- 
mentation  of  this  technique  would  have  complicated  both  the  equipment  and  the  administration 

..  *1^  .lt  ^en  Welded  to  test  over  considerably  fewer  light  levels  (and  contrasts),  one  of 

the  other  instruments  might  have  been  chosen  and  the  reduced  light  levels  achieved  by  phys¬ 
ically  combining  neutral-density  filters  with  the  test  slides.  Indeed,  this  is  essentially  what 
was  done  to  one  drum-type  instrument,  the  Armed  Forces  Vision  Tester  [10]  (itself  a  military 
adaptation  of  a  more  elaborate  version  of  the  Ortho-rater),  to  produce  the  Army  Night  Seeing 
Tester,  Model  I  [11].  The  latter  is  understood  to  have  been  a  device  which  provided  limited 
tests  of  contrast  discrimination  and  resolution,  but  at  only  one  reduced  light  level  (in  the 
mesopic  vision  range). 
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of  the  tests;  further,  assuming  the  test  answers  were  to  be  changed  from  contrast  to  contrast, 
it  would  not  have  reduced  the  number  of  slides  required. 

By  choosing  a  compact,  box-like,  stereoscopic  instrument,  the  size  and  baffling  problems 
associated  with  a  darkroom  were  avoided  (though  baffles  were  still  required  for  the  interior 
of  the  instrument),  and  the  light  integrity  of  the  instrument  could  be  readily  ensured.  This, 
together  with  the  fact  that,  when  the  observer  is  looking  into  the  instrument,  his  peripheral 
vision  is  largely  obstructed,  meant  that  although  the  tests  would  still  have  to  be  conducted  in  a 
darkroom,  the  light  integrity  of  the  darkroom  could  now  be  somewhat  less  than  perfect.  Thus, 
since  the  tests  could  be  made  portable  simply  by  adding  a  self-contained,  portable  power  sup¬ 
ply,  it  was  apparent  that  they  could  even  be  conducted  outdoors  where  the  "darkroom"  would 
be  the  sky  on  a  dark  night.  Though  choosing  this  method  meant  that  only  one  subject  at  a  time 
could  be  tested,  this  seemed  a  small  price  to  pay  for  the  versatility  obtained. 

3.3.  SELECTION  OF  THE  TARGET  AND  QUANTIFICATION  OF  THE  PARAMETERS 

Since  the  selection  of  a  disk  target  would  require  a  separate  reference  frame,  it  was  evi¬ 
dent  that  this  frame  would  have  to  be  provided  on  the  slides  and  be  different  from  the  type  of 
frame  that  Blackwell  [4]  had  used,  and  this  would  introduce  uncertainty  about  the  applicability 
of  Blackwell  s  data.  (Blackwell  used  a  small  red  light  at  the  center  of  an  imaginary  circular 
"orbit"  along  which  the  disks  were  placed).  Figure  1  illustrates  the  problem:  An  n-sided 


(a)  Interior  Reference  Frame 


(b)  Exterior  Reference  Frame 

FIGURE  1.  EXAMPLE  OF  THE  TYPE  OF  REFER¬ 
ENCE  FRAME  NEEDED  FOR  DISK-SHAPED  TARGETS 
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regular  geometric  polygon  would  have  had  to  be  placed  in  either  an  interior  or  exterior  rela¬ 
tion  to  the  disks,  with  the  corners  used  to  mark  the  proximate  disk  locations  and  with  the  value 
of  n  determined  by  reliability  considerations.  Even  though  a  square  exterior  frame  (fig.  lb) 
is  used  in  one  commercial  instrument,  it  was  decided  that,  to  increase  reliability,*  an  octag¬ 
onal  frame  should  be  used  for  which  no  real  precedent  existed.  More  importantly,  since  there 
was  not  sufficient  time  to  experimentally  settle  questions  on  the  relative  sizes  and  proximity 
of  the  reference  frames  and  disks,  it  was  thought  better  to  use  the  Landolt  C  target,  for  which 
no  real  problems  of  this  type  existed  and  for  which  an  n  =  8  precedent  did  exist  [6| . 

The  next  step  was  to  decide  what  background  luminance  values,  contrasts,  and  Landolt  C 
sizes  should  be  included  in  the  tests.  In  this  connection,  it  is  important  to  recognize  that  selec¬ 
tion  of  the  method  of  implementation  described  above  meant  that  each  of  the  threshold  param¬ 
eters  would  be  a  discrete  variable.  To  review,  the  light  levels  would  be  set  by  neutral-density 
filters  and  the  contrasts  and  sizes  by  what  would  be  on  the  slides  themselves.  The  significance 
of  discreteness  is  that  it  leads  to  built-in  systematic  errors  in  the  tests.  Therefore,  selecting 
values  for  the  parameters  reduced  to  deciding  how  much  systematic  error  would  be  tolerable; 
this  in  turn  had  to  be  weighed  against  practical  problems  such  as  limiting  the  number  of  filters 
and  slides  for  purposes  of  handling.  In  order  to  size  the  built-in  systematic  errors,  first  two  of 
the  three  threshold  parameters  had  to  be  selected  and  then  the  values  for  these  two  parameters 
for  various  values  of  the  third  parameter  had  to  be  chosen.  This  amounted  to  choosing  the 
most  important  two-dimensional  orthogonal  projection  of  the  visibility  threshold  surface; 
visual  angle  versus  background  luminance  (for  various  contrasts)  was  selected  because  these 
parameters  vary  when  a  natural  scene  is  viewed,  whereas  contrast  is  essentially  an  invariant 
of  the  scene.  Figure  2  shows  the  data  in  references  6-8  plotted  this  way.  (For  the  data  in  refs. 
7  and  8,  the  longest  exposure  time,  0.?  sec,  was  used  since  it  was  assumed  that  this  gave  the 
same  results  as  if  an  indefinitely  long  time  had  been  used,  as  was  the  case  for  the  data  in 
ref.  6.)  Actually,  the  curves  in  figure  2  are  interpolations  from  figure  3,  where  the  data  are 
more  accurately  represented  by  the  projection  contrast- versus- visual  angle  (for  various  back¬ 
ground  luminances).  For  both  figures,  contrast  is  expressed  in  terms  of  modulation:*  *  this 


*Test  reliability  may  be  understood  as  follows:  If  an  observer  were  to  surpass  his  true 
threshold  by  guessing,  the  chance  of  his  exceeding  his  threshold  by  some  amount  would  be  1/n 
for  the  first  try,  l/n2  for  the  second  try,  and  so  on. 

*  *  Modulation,  M,  may  be  defined  in  terms  of  test  objective  luminance,  B^,  and  background 
luminance,  Bg,  as  M  =  (B^  -  Bg)/(B-j,  +  Bg).  Sc  defined,  M  is  a  qunatity  which  varies  be¬ 
tween  -1  and  +1  and  does  not  change  in  kind  with  a  sign  reversal.  Because  of  the  assumption 
that  Landolt  C's  in  positive  and  negative  contrast  are  equally  visible,  only  absolute  (i.e.,  al¬ 
ways  positive)  values  of  M  are  considered  in  the  discussion.  In  converting  the  Cobb  and  Moss 
[7,  8]  version  of  contrast  to  modulation,  their  original  data  were  also  corrected  to  remove  an 
apparent  discrepancy  which  resulted  from  using  a  set  of  reflectivity  values  for  computing  con¬ 
trast  which  differed  from  those  stated  to  have  been  available. 
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Modulati 


'Data  In  reference 


on  dark  Landolt  C's 


[against  a  light  background 

Data  In  references  7  and  8  on  dark  two-bar 

patterns  against  a  light  background 


10  ’  10  10*  1 
BACKGROUND  LUMINANCE  (mL) 


FIGURE  2.  VISUAL  ANGLE  VERSUS  BACKGROUND 
LUMINANCE  FOR  VARIOUS  MODULATIONS  [6-8]. 
These  curves  are  based  on  Interpolations  from  the 
data  in  figure  3. 


differs  from  the  expression  used  in  references  6-8,  but  the  conversion  from  the  tabulations  of  the 
datapresented  there  was  easily  and  accurately  made.  (Aside  from  the  conceptual  theoretical 
advantages  of  using  modulation,  this  version  of  "contrast"  was  chosen  because  it  seems  to  be 
emergingas  a  standard.)  The  modulations  given  in  figure  2  (100,  50, 20, 10,  5, 2, 1%)  are  the  nomi¬ 
nal  values  of  those  actually  selected  for  the  tests;  though  these  values  were  chosen  in  part  to 
be  suitable  for  reproducing  figure  3,  the  selection  was  otherwise  arbitrary  except  for  1%  and 
2%,  which  are  sometimes  used  in  describing  practical  resolution  limits  for  certain  types  of 
electro -optical  aids. 

The  luminance  values  and  visual  angles  were  conjointly  selected  to  enable  reproduction  of 
figure  2  and  to  realistically  minimize  the  visual -angle  error;  i.e.,  the  burden  for  systematic 
error  was  placed  on  visual  angle.  In  achieving  these  goals,  the  following  factors  were  consid¬ 
ered:  the  light  output  of  available  bulbs,  whether  the  slides  should  be  in  positive  or  negative 
contrast,  and  the  density  of  available  filters.  When  it  was  learned  that  the  maximum  output  of 
available  bulbs  would  give  a  luminance  for  the  intervening  diffusing  plate  no  higher  than  the 
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VISUAL  ANGLE  (min) 


FIGURE  3.  MODULATION  VERSUS  VISUAL  ANGLE 
FOR  VARIOUS  BACKGROUND  LUMINANCES  [6-8] 

highest  value  being  considered  for  the  tests  (~  102  mL),  it  became  evident  that  the  slides  would 
have  to  be  in  negative  contrast,  i.e.,  the  targets  darker  than  the  background  and  the  density  of 
the  lighter,  more  transparent  background  the  same  low  value  (fog  density)  for  each  slide. 

Since  neutral-density  filters  were  most  readily  available  in  (diffuse)  optical  densities  which 
varied  in  unit  steps  (transmission  in  decade  steps),  and  since  sampling  in  decade  steps  seemed 
to  give  reasonable  coverage,  this  was  the  approach  selected.  To  make  room  for  the  filters 
(which  when  inserted  into  the  machine  were  placed  in  close  contact  with  that  side  of  the  diffus¬ 
ing  plate  closest  to  the  bulb)  and  to  prevent  their  becoming  overheated  by  the  bulb,  the  bulb 
was  moved  away  from  the  filters  along  the  optical  axis  to  a  distance  of  approximately  3  1/4  in. 

To  counterbalance  the  decrease  in  luminance  which  resulted  from  this  change,  the  wattage  of  the 
bulb  enclosed  in  the  Ortho-rater  was  increased  from25to40.  These  things  taken  together  resulted  in 
the  following  luminances:  55  to  60  mL  luminance  maximum  x  10'D,  where  D  is  the  (diffuse)  optical 
density  of  the  filters  used  and  D  =  0, 1 , 2,  3,  4,  5,  6,  7.  The  range  55  to  60  mL  accounts  partly  for  varia¬ 
tions  in  luminance  due  to  innate  manufacturing  differences  in  the  bulbs  and  partly  for  some 
aging  of  each  bulb  before  it  is  replaced;  i.e.,  55  mL  represents  an  arbitrarily  selected  lower 
acceptable  limit  for  the  tests.  (A  photometer  is  supplied  with  the  equipment  to  check  this.) 

The  color  temperature  of  the  light  from  the  bulb  is  approximately  2800°K.  An  internal  micro¬ 
switch  in  the  Ortho-rater  which  operates  only  when  a  filter  is  completely  inserted  protects  the 
observer's  state  of  adaptation  to  darkness  and  accounts  for  the  necessity  of  a  zero-density 
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The  next  problem  considered  was  how  close  the  visual-angle  steps  should  be.  The  follow¬ 
ing  scheme  was  adopted.  Starting  with  10  minutes  of  arc,  the  smaller  angles  differ  by  log 
unit  steps  of  0.05  (a  factor  of  1.122),  whereas  the  larger  angles  differ  by  log  unit  steps  of 
0.10  (a  factor  of  1.259).  Though  use  of  the  smaller  (0.05  log  unit)  steps  above  10  minutes  of 
arc  would  have  produced  more  accurate  results  in  this  range,  the  larger  (0.10  log  unit)  steps 
were  selected  because  (1)  the  additional  accuracy  did  not  seem  worth  the  effort  of  making  the 
extra  slides  that  would  have  been  necessary,  and  (2)  the  larger  steps  still  fit  well  with  the  ex¬ 
pected  data.  (Predictions  for  the  data  were  based  in  large  part  on  linear  extrapolations  from 
the  data  in  ref.  6.)  The  systematic  error  thus  established  as  tolerable  can  be  understood  by 
noting  that  the  actual  threshold  could  be  within  a  step  and,  in  a  limiting  sense,  as  large  as  a 

step.  Further,  since  the  angle  subtended  by  an  object  varies  inversely  as  the  range  of  that  ob¬ 
ject,  selecting  steps  as  indicated  was  equivalent  to  saying  that  predictions  of  the  range  at  which 
an  object  could  be  seen  might  differ  by  the  factors  given  and  still  be  acceptable  (see  fig.  4). 
Besides  displaying  the  parametric  relationship  between  object  size,  angular  subtense,  and  ob¬ 
ject  range,  figure  4  shows  the  actual  visual-angle  steps  selected  as  well  as  some  representative 
values  for  the  critical  dimensions  of  selected  types  of  objects.  The  decision  to  use  the  larger 
steps  was  in  part  based  on  an  assessment  of  the  importance  of  the  range  differences  for  these 

selected  objects.  (The  critical  dimensions  shown  in  figure  4  are  based  on  some  unpublished 
work  by  the  author.) 

Thirty-five  Landolt  C  acuity  slides  were  prepared  consisting  of  five  slides  for  each  of  the 
seven  modulations  selected  (100,  50,  20,  10,  5,  2  and  1%).  Each  such  set  of  five  slides  displays 
Landolt  C’s  in  the  same  way;  i.e.,  C’s  of  the  same  size  (though  of  generally  differing  orienta¬ 
tions)  are  displayed  in  the  same  order  with  the  same  number  on  each  slide.  A  total  of  35  C 
sizes  were  used  which  yield  visual  angles  ranging  from  0.794  through  79.4  minutes  of  arc  in 
steps  determined  by  the  scheme  described  above.  The  exact  visual  angles,  their  Snellen  rating 
equivalents,  and  the  orientations  used  for  the  C’s  are  given  in  table  I.  The  paired  modula¬ 
tions  in  the  table  result  from  the  original  intention  to  test  each  subject  over  only  one  of  the 
following  sets  of  modulations:  100,  50,  and  5%;  100,  20,  and  2 %;  or  100,  10,  and  1%.  This  in 
turn  was  the  result  of  overestimating  the  time  required  to  test  a  subject  over  one  of  these 
sets.  Consequently,  to  test  subjects  over  all  the  modulations  and  to  avoid  carry-over  from 

one  modulation  to  the  next,  slides  having  C's  of  the  same  orientation  are  best  given  in  differ¬ 
ent  sessions. 

As  may  be  inferred  from  the  table,  when  there  were  more  than  two  C’s  on  a  slide,  they 
were  arranged  in  horizontal  rows  with  their  sizes  diminishing  from  left  to  right  in  the  top 
row,  then  from  right  to  left  in  the  next  row,  and  so  on.  Thus,  to  observe  the  C’s  in  consecu¬ 
tive  order,  they  must  be  viewed  in  zig-zag  fashion.  This  arrangement  was  adopted  to  permit 
close  packing  of  the  C's  on  the  slides  and  to  help  minimize  the  total  number  of  slides  to  be 
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TABLE  L  BASIC  CHARACTERISTICS  OF  THE  LANDOLT  C  ACUITY  SLIDES 


Nominal 

Nominal 

Visual 

Orientations  for  Modulations 

Slide 

Step 

Snellen 

Angle 

Indicated 

Number 

Number 

Rating 

(min) 

Layout  * 

100% 

50%,  2% 

20%,  1% 

10%,  5% 

1 

20/16 

0.794 

Bottom 

SE 

E 

W 

S 

2 

20/18 

0.891 

row 

sw 

S 

NE 

SE 

3 

20/20 

1.00 

w 

NE 

N 

S 

4 

20/23 

1.12 

-i 

E 

SW 

NW 

W 

5 

20/25 

1.26 

L 

N 

w 

SE 

SW 

1 

6 

20/28 

1.41 

Middle 

• 

SE 

NE 

SW 

NW 

7 

20/32 

1.58 

row 

N 

SE 

S 

E 

8 

20/36 

1.78 

R 

S 

SW 

SW 

SE 

9 

20/40 

2.00 

R 

W 

E 

SW 

N 

10 

20/45 

2.24 

Top  row 

1 

SW 

N 

S 

S 

11 

20/50 

2.51 

L 

w 

E 

NE 

s 

12 

13 

20/56 

20/63 

2.82 

3.16 

Bottom  row 

L 

♦ 

R 

sw 

NE 

S 

W 

N 

N 

sw 

NW 

14 

20/71 

3.55 

1 

* 

s 

N 

SW 

w 

15 

20/80 

3.98 

i 

SE 

SE 

NE 

E 

16 

20/89 

4.47 

Lower - 

SW 

SW 

SW 

W 

17 

20/100 

5.01 

middle 

NW 

E 

SE 

SW 

18 

20/113 

5.62 

row 

SW 

E 

S 

NE 

19 

20/126 

6.31 

W 

S 

NE 

N 

20 

20/142 

7.08 

1 

J 

N 

NW 

E 

SE 

2 

21 

20/159 

7.94 

1 

J 

E 

NE 

W 

SW 

22 

20/178 

8.91 

Upper- 

1 

N 

S 

E 

SE 

23 

20/200 

10.0 

middle 

NE 

NW 

NE 

W 

24 

20/252 

12.6 

row 

E 

SE 

SW 

NW 

25 

20/316 

15.8 

R 

NW 

SW 

N 

W 

26 

20/400 

20.0 

R 

SE 

SW 

S 

s 

27 

20/504 

25.1 

Top  row 

1 

1 

NW 

N 

NE 

sw 

28 

20/632 

31.6 

] 

L 

NE 

NW 

NW 

s 

29 

20/800 

39.8 

Lower  right 

NW 

NE 

NW 

SE 

O 

30 

20/1000 

50.1 

Upper  left 

W 

SW 

SW 

SW 

4 

31 

20/1260 

63.1 

Center 

E 

E 

NW 

NW 

5 

32 

20/1590 

79.4 

Center 

N 

NW 

W 

W 

*R  -  L  means  from  right  to  left,  and  L  -  R  means  from  left  to  right. 
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handled.  Figure  5  shows  the  layout  ol'  the  slides  tv- 

more  than  one  C  means  that,  to  prevent  the  r  ■  '  hat  most  of  the  slides  display 

ducted  beginning  with  the  lowest  light  level  (-  “h  t"”"8’  ‘he  'eS‘S  m"St  ** 

from  one  light  level  to  the  next  Indeed  -er  f  *"  hen  workin8  successively  upward, 
in  this  way  led  to  placing  mo«  ttan  wo  C  s  ^  ^  “">d  b* 

duction  the  number  of  slides  reouired  1  Z  ^  *  C°"Sl“  «•- 

avoided  uncertainties  about  ~  “  “ 

been  conducted  in  exactly  the  opposite  manner  1  e  h  T  “  'he  ‘eS‘S 

(Whereas  adaptation  to  a  higher  light  level  takes  place  ^  d0W"Ward  tovel- 

lower  level  does  not;  the  time  reouired  d»  h  V  lnstantane°usly,  adaptation  to  a 

ally  Increases  as  both  of  these  decrease  aTdV  '"t"  fl"al  “ght  levels  and  B<™r- 

cise  times  were  not  known.)  While  t  leVe'S  “nder  “nsideration,  the  pre¬ 

acuity  during  adaptation  to  the  lowest  110*  tal”  taresT"!-1*  t0Und  WhiCh  deSCribed  Undolt  c 
and  Brown  et  al.  [14J  indicate  that  30  min  would  protablTb”*  ^  ^  f'3]’ 

complete  adaptation;  accordingly,  this  was  the  time  allocated’  e"°“Sh  ‘°  aCMeVe 

...  -- -rrrrrzr  rrr  •••  - *-  >  -- 

slides  already  prepared  for  the  postadaptation  tests,  those  ^ 

because  only  they  seemed  likely  to  cover  a  range  of  vis  i  ,  %  modutahon  were  chosen 

adaptation  test.  In  deciding  upon  a  known  starting  point”, or  taLTesTT'”"1  ^  *  dart' 
highest  light  level  used  in  the  tests  would  he  „■  „  ’  Seemed  llkely  that  the 

-  r°°m  ug:;z:z:,  ::r:  ~ any  ~ state  °f 

this  light  level  (for  1  min,  before  taking  the  dark-adaptation Z.  ”  Sh0,lld  PreadaPt '° 

3.4.  TEST  PROCEDURE  AND  SCORING 

«  zrzz:::z::ziTr-  r the  dark— ~  -  *-  - 

mL)  a"d  tbe"  30  -  'or  adaptation  to  the  ^  '°0 

fon,  a  record  is  made  o,  the  times  required  by  an  observer  to  correct.;  state”, he “  T 
tions  of  successively  smaller  100%  modulation  Landolt  C's  Upon  co  .  r  °  ' 

af  the  end  of  30  min),  the  postadaptation  tests  are  given  These  b  7T  "  ^  **  ^ 
and  then  work  successively  upward  through  the  lu,  ’ ,  ““  l0WCSt  lisht  level 

through  filters  6,  5  4  3  2  1  and  0  T  ?  ‘°  WgheS*’  ‘'e-  "Ita,  7 

100%  contrast,  taen’  a  m^m  ZL^T^T'’ C°n‘ra8tS  " 

-  ~  ~  r~: 


20 


WILLOW  RUN  LABORATORIES 


o 


Goo 

occoO 

C  O  O  O  o  o  o 

o  o 


Goo 

3COOQ 

C  O  O  o  o  o  o 

o  o 


o  O 


FIGURE  5.  LAYOUT  OT  LANDOLT  C  TEST  SLIDES 
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somewhat  less  than  2  hr;  this  includes  instruction  time  and  time  for  a  rest  pause  generally 
taken  after  the  scotopic  vision  postadaptation  tests  (filters  7,  6,  5)  and  before  the  photopic 
vision  postadaptation  tests  (filters  4,  3,  2,  1,  0). 

The  scoring  system  adopted  for  the  postadaptation  tests  is  the  same  as  that  employed  in 
the  standard  Ortho-rater  tests.  At  each  light  level,  tests  with  a  given  contrast  are  terminated 
when  (1)  the  observer  says  he  can  go  no  further,  or  (2)  the  observer  misses  the  orientations 
twice  consecutively.  The  observer's  score  is  the  last  correct  answer.  In  the  event  the  ob¬ 
server  misses  one  C,  views  the  next  one  correctly,  and  then  misses  again,  the  experimenter 
stops  him  and,  without  telling  him  that  he  has  missed,  retests  beginning  with  the  C  two  steps 
larger  than  the  first  one  missed.  Usually  the  observer  corrects  his  first  miss;  however,  if 
the  original  sequence  persists,  the  first  miss  is  ignored  in  scoring.  (In  this  case,  the  experi¬ 
menter  later  re-examines  the  slide  for  defects  or  dirtiness  which  might  have  caused  the  mis¬ 
takes.)  The  observer  is  not  told  the  scoring  rules;  his  instructions  are,  "Keep  indicating  the 
orientations  until  you  think  you  can  go  no  further,  or  until  you  are  told  to  stop."  Allowing  the 
observer  to  stop  the  test  himself  is  a  departure  from  the  more  proper  psychophysical  forced- 
choice  test  procedure,  but  this  is  mitigated  by  the  size  of  steps  from  one  target  to  another, 
making  it  entirely  possible  that  the  jump  to  the  next  smallest  C  would  bring  the  observer  to  a 
chance  success  level  anyway.  It  has  been  found  that  when  some  observers  say  they  cannot  go 
further,  they  are  actually  capable  of  doing  better;  therefore,  each  time  an  observer  says  he 
would  stop,  he  is  asked,  "Are  you  sure  you  cannot  go  further?"  It  has  been  found  that  the  im¬ 
provement  which  may  result  usually  does  not  exceed  one  or  two  steps. 

For  the  dark- adaptation  tests,  the  time  it  takes  the  observer  to  make  correct  responses 
is  measured.  If  the  observer  makes  an  incorrect  call,  the  experimenter  first  attempts  to  re¬ 
test  by  removing  and  reinserting  the  same  slide,  or,  if  the  slide  has  a  sing'e  C  which  is  not 
pointed  east  or  west,  by  removing  the  slide,  flipping  it  over  so  that  the  top  becomes  the  bottom, 
and  reinserting  it.  In  the  latter  case,  all  northerly  directions  will  become  southerly  and  vice 
versa.  If  the  observer  again  makes  a  mistake,  this  size  C  is  skipped,  and  the  experimenter 
proceeds  to  the  next  smallest  one.  The  experimenter  does  not  tell  the  observer  whether  he  is 
right  or  wrong  during  adaptation,  since  afterwards  the  observer  is  tested  over  the  same  100% 
contrast  C’s  in  accordance  with  the  postadaptation  rules.  The  observer  may  indicate  which  of 
the  eight  possible  gap  orientations  is  correct  by  using  any  one  of  the  following  methods: 

(1)  Verbal  response 

(a)  Major  compass  points:  N,  NE,  E,  SE,  etc. 

(b)  Directions:  right,  left,  top,  bottom;  top  right,  top  left;  etc. 

(c)  Clock  system:  12  o'clock,  1  o'clock,  6  o'clock,  etc. 
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(2)  Finger  pointing  (equivalent  to  verbal  response):  the  subject's  finger  is  wrapped  with 
phosphorescent  tape  which  gives  off  enough  light  to  be  seen  by  the  experimenter. 

To  enable  the  recording  of  test  scores  in  the  dark,  an  auxiliary  console  unit  was  developed 
which  incorporates  a  red  illuminator  light  for  use  as  a  scoring  table,  a  strip-chart  recorder 
for  use  in  recording  adaptation  times,  and  a  constant  voltage  transformer  for  powering  the 
Ortho-rater  light  bulb.  For  aid  in  locating  the  slides,  the  filters,  and  certain  portions  of  the 
instrumentation  in  the  dark,  labels  made  of  phosphorescent  tape  are  used.*  Figure  6  shows  a 
typical  test  setup.  The  experimenter  sits  facing  the  console  unit  with  the  Ortho-rater  to  his 


FIGURE  6.  SETUP  FOR  ADMINISTERING  THE  TESTS 


The  observer  s  state  of  adaptation  to  darkness  is  essentially  unaffected  by  light  from  the 
phosphorescent  tape  or  from  the  illuminator.  Light  from  the  tape  rapidly  decays  in  the  dark 
to  a  very  low  level;  moreover,  the  tape  usually  cannot  be  seen  by  the  observer.  Since  the  illu- 

Zrx\o?3ht‘lr^u^V?lefingthH%6,0°r,)  “  haS  eSSentla“>'  “  •“**  on  the  rod  vis“„  used  be- 
,  ...  10.  I?L/?  terS7’06’0and  Whlle  thls  ueht  could  possibly  affect  the  cone  vision  used 

at  higher  levels  (filters  4,  3,  2,  1  and  0),  it  is  deliberately  kept  at  a  low  level,  and,  at  any  rate 
the  observer  generally  cannot  see  it.  ’  y  e’ 
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right.  One  neutral-density  filter  has  been  inserted  into  the  rear  slot  of  the  Ortho-rater,  and 
the  rest  are  readily  accessible  in  the  standard  wooden  base  of  the  machine.  One  test  slide  is 
in  place  in  the  front  slot,  and  the  rest  of  the  slides  being  used  are  on  the  table  in  front  of  the 
experimenter. 

3.5.  THE  FORM-RECOGNITION  TEST 

The  decision  todevelop  a  real-life  form  test  was  not  reached  until  some  time  after  the  acuity 
tests  ar.d  instrumentation  were  in  the  process  of  being  implemented.  Hence,  although  the 
latter  influenced  the  design  of  the  form-recognition  test,  the  converse  was  not  true.  One  way 
the  form -recognition  test  was  influenced  was  in  the  time  that  could  be  allocated  for  it;  since 
obtaining  Landolt  C  acuity  data  seemed  likely  to  take  most  of  the  4-hr  period  assumed  as  the 
limit  for  all  testing,  it  was  clear  that  the  form-recognition  test  could  not  be  allowed  to  take 
up  much  time.  Further,  the  Landolt  C  slides  were  much  more  difficult  to  prepare  than  had 
been  anticipated,  so  that  considering  time,  manpower,  and  cost  limitations  (as  well  as  the  de¬ 
sire  to  minimize  the  total  number  of  slides),  it  seemed  best  to  plan  on  making  as  few  real-life- 
form  slides  as  possible.  For  these  reasons,  it  seemed  evident  that  no  more  than  one  real-life 
form  and  no  more  than  one  seeing  task  could  be  considered.  Partly  because  of  its  obvious 
military  importance  and  partly  because  it  would  be  familiar  to  members  of  any  population,  the 
form  selected  was  that  of  a  man.  The  seeing  task  chosen  was  more  difficult  to  decide  upon, 
and  still  more  difficult  to  implement.  Though  military  seeing  tasks  run  the  gamut  from  "detec¬ 
tion"  of  a  man  (i.e. ,  sensing  his  presence)  to  a  range  of  "recognitions"  involving  various  critical 
dimensions,  it  seemed  best  to  choose  a  task  difficult  enough  to  involve  cognitive  processes  of  a 
higher  order  than  those  involved  in  detection,  and  yet  not  too  complicated. 

The  task  chosen — recognition  of  the  man  as  a  man  —  seemed  a  good  compromise,  but 
there  remained  the  problem  of  how  to  build  validity  and  reliability  into  the  test.  With  regard 
to  reliability,  it  may  be  noted  that  the  problem  for  real-life  forms  is  essentially  no  different 
in  kind  from  the  problem  of  deception  in  acuity  tests  (see  sec.  3.1).  The  method-of-limits 
approach  was  rejected,  as  it  was  for  the  acuity  test,  because  here  it  seemed  even  more  likely 
to  lead  to  variation  in  interpreting  the  nature  of  the  task.  It  was  decided  that  the  procedure 
should  be  similar  to  that  adopted  for  the  acuity  test;  i.e.,  the  test  should  (1)  give  the  observer 
the  opportunity  to  make  mistakes  when  he  is  not  able  to  perform  the  required  recognition  task, 
and  (2)  give  him  less  than  an  even-chance  opportunity  for  guessing  the  correct  answer.  It 
should  be  emphasized  that  it  would  not  have  been  valid  to  use  a  test  which  simply  presented  the 
form  of  a  man  in  one  of  a  number  of  space /time  locations  with  nothing  in  the  other  locations. 

This  would  have  been  no  different  from  the  method  of  limits  and  probably  would  have  amounted 
to  a  detection  rather  than  a  recognition  test.  (That  some  type  of  recognition  might  occur  si¬ 
multaneously  with  detection  would  be  irrelevant;  there  would  be  nothing  about  the  test  itself  to 
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lend  credence  to  the  claim  that  the  man  had  been  recognized  as  a  man.)  To  provide  the  kind  of 
test  desired,  it  was  necessary  to  use  false  targets  in  the  other  locations,  the  visibility  of  which 
would  be  equal  to  but  not  greater  than  that  of  the  target  of  interest  and  the  appearance  similar 
enough  to  compel  the  kind  of  recognition  required.  In  other  words,  the  false  targets  had  to  be 
such  that  when  the  contrast  and  background  luminance  were  not  high  enough  to  enable  the  ob¬ 
server  to  see  the  critical  dimension  of  the  real  target,  then  the  false  targets  would  appear  to 
him  to  be  forms  of  a  man.  It,  on  the  other  hand,  the  false  targets  were  visible  when  the  man 
was  not,  then  the  man  could  be  identified  by  a  process  of  elimination  (since  the  observer  would 
already  know  that  the  siilht  uette  of  a  man  was  present  by  virtue  of  the  fact  that  he  had  been 
shown  an  example  of  the  slide),  test  validity  would  be  jeopardized,  and  reliability  would  be  re¬ 
duced.  (Reliability  would,  of  course,  depend  upon  the  number  of  false  targets  used.) 

A  part  of  the  implementation  ^xoblem,  then,  was  to  decide  what  form  these  false  targets 
should  take.  Though  real-life  forms  other  *han  that  of  a  human  being  were  considered,  they 
were  rejected  for  two  reasons.  First,  there  was  no  guarantee  that  observers  would  not  be 
familiar  enough  with  such  forms  that  they  could  readily  distinguish  them  from  the  form  of  a 
man  (especially  if  they  were  allowed  to  see  them  once  during  the  course  of  the  test).  Second, 
there  was  no  assurance  that  the  visibility  of  these  forms  could  be  made  equal  to  or  less  than 
that  of  the  target  of  interest.  Indeed,  as  indicated  in  the  discussion  on  acuity  tests,  controlling 
the  visibility  of  any  target  by  the  design  of  its  parts  can  at  best  be  done  only  approximately. 

The  decision  taken,  therefcie,  was  to  use  forms  that  would  be  unfamiliar  to  any  observer,  not 
easily  remembered,  but  designed  to  have  roughly  the  same  overall  appearance  and  detail  as 
the  form  of  a  man.  Various  nonsense  forms  were  devised  to  meet  these  criteria;  those  which 
bore  either  too  much  or  too  little  resemblance  to  a  man  were  eliminated  (subjectively,  because 
of  time  limitations)  and  the  remainder  adopted  for  the  test.  Figure  7  shows  the  nonsense  forms 
finally  selected  and  the  silhouette  of  the  man.  'Actually,  this  figure  shows  one  side  of  a  stereo 
slide  layout  used  in  the  tests.)  There  are  seven  nonsense  forms,  so  that  the  chance  of  identify¬ 
ing  the  man  is  one  in  eight,  the  same  as  for  guessing  the  Landolt  C  gap  orientation.  The  method 
used  in  designing  the  nonsense  forms  is  an  adaptation  of  Attneave  and  Arnoult's  Method  1  [15], 
which  involves  connecting  randomly  chosen  grid  coordinates  in  such  a  way  as  to  produce  the 
closed  boundary  which  outlines  the  silhouettes.  In  adapting  this  method,  it  was  decided  that 
not  all  the  coordinates  should  be  randomly  chosen;  instead,  to  achieve  the  desired  degree  of 
overall  similarity  to  the  silhouette  of  the  man,  five  points  (shown  on  the  man  in  fig.  7)  should 
be  common  to  all  the  forms.  (For  one  of  the  forms,  the  second  from  the  left  on  the  bottom 
line,  points  2  and  4  were  inadvertently  shifted  downward.)  The  other  coordinate  pairs  were 
then  randomly  located  within  a  rectangular  grid  no  higher  than  point  3  and  essentially  no  wider 
than  points  2  and  4.* 

(Footnote  on  following  page.) 
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FIGURE  7.  LAYOUT  OF  THE  HUMAN- FORM-RECOGNITION  TEST  SLIDE 


Consideration  was  next  given  to  the  procedure  for  administering  the  test.  Given  any  one 
contrast  value  and  any  one  of  the  light  levels,  an  ad  hoc  critical  dimension  could  be  determined 
in  the  following  manner:  (1)  make  up  slides  with  forms  varying  in  size  in  some  predetermined 
manner  (say  in  the  same  way  as  for  the  acuity  tests)  and  varying  randomly  in  location  from 
slide  to  slide;  (2)  have  an  observer  pick  out  the  form  of  the  man;  (3)  knowing  the  actual  size  of 
the  man  (appropriately  scaled  down  for  the  20-ft  Ortho-rater  viewing  distance),  compute  the 
critical  dimension  by  matching  the  degree  of  difficulty  of  seeing  the  smallest  man  visible  at 
the  given  light-level  and  contrast  values  with  the  minimum  Landolt  C  visual  angle  for  those 
values.  Several  slides  (probably  five  to  seven)  would  be  required  for  this  procedure,  and  to 
use  it  as  the  basis  for  establishing  invariance,  i.e.,  to  repeat  it  for  more  than  one  contrast  and 
light  level,  would  necessitate  an  impractically  high  number  of  slides.  As  an  alternative,  a  less 

"Seven  other  coordinate  pairs  originally  were  plotted,  based  on  the  notion  that  these  plus 
the  five  constant  points  would  give  as  many  major  inflections  on  the  boundaries  of  the  nonsense 
forms  as  seemed  present  on  the  silhouette  of  the  man.  This  proved  not  to  be  the  case  how¬ 
ever,  because  the  method  used  required  that  "interior  points"  be  connected  to  the  "outer 
boundary." 


26 


WILLOW  RUN  LABORATORIES 


precise  test  of  invariance  could  be  made  using  slides  with  forms  of  the  same  size  but  covering 
all  seven  (or  less)  contrasts  used  in  the  acuity  tests  (and  thus  requiring  seven  or  less  slides). 
Since  five  to  ten  slides  seemed  a  practical  limit  to  the  number  of  additional  slides  to  be  made, 
it  was  necessary  to  decide  between  precisely  establishing  one  ad  hoc  critical  dimension  or 
making  a  somewhat  imprecise  test  of  invariance.  Since  the  former  would  result  in  precise 
knowledge  about  only  one  particular  target-seeing  task,  and  the  latter  would  shed  light  on  a  far- 
reaching  principle,  the  decision  was  in  favor  of  the  latter;  moreover,  it  was  noted  that  if  in¬ 
variance  did  hold,  then  this  latter  procedure  would  provide  a  desirable  kind  of  redundancy  not 
obtainable  with  the  first  procedure  and  possibly  an  even  better  measure  of  the  critical  dimen¬ 
sion. 

In  keeping  with  the  above  decision,  seven  slides  were  prepared  covering  each  of  the  seven 
contrasts  used  in  the  acuity  tests.  These  slides  are  used  as  follows.  Concurrently  with  the 
postadaptation-acuity  tests,  they  are  shown  at  each  light  level,  starting  with  the  lowest  con¬ 
trast  and  working  upwards  until  the  observer  can  correctly  identify  the  location  of  the  man. 

This  gives  a  minimum  contrast  required  to  see  the  man,  which,  together  with  the  light  level, 
can  be  used  to  specify  a  task  equivalent  in  difficulty  to  seeing  a  Landolt  C  target  of  the  same 
contrast  at  the  same  light  level;  i.e.,  the  visual  angle  for  the  Landolt  C  would  indicate  the  dif¬ 
ficulty  of  the  task.  Since  the  objects  seen  are  all  the  same  size,  if  they  were  to  have  the  same 
critical  dimension,  then  the  same  visual  angle  would  result  no  matter  what  the  contrast  and  light 
level.  As  shown  in  section  4,  preliminary  results  suggest  that  this  is  the  case  and  that  invari¬ 
ance  is  thus  confirmed. 

The  actual  size  selected  for  the  targets  was  based  on  an  assumption  about  the  magnitude 
of  the  invariant  critical  dimension  likely  to  be  involved,  a  desire  to  cover  as  broad  a  contrast 
range  as  possible  (commensurate  with  the  contrasts  available),  and  a  desire  to  be  "realistic." 
The  critical  dimension  was  assumed  to  be  3  in.,  or  rather,  3  in.  scaled  down  from  a  realistic 
target  size  to  that  actually  presented  at  the  apparent  20-ft  viewing  distance  of  the  Ortho-rater. 
The  visual  angle  chosen  corresponding  to  this  dimension  was  4  minutes  of  arc  (20/80  Snellen); 
this  choice  was  arbitrary  except  that,  referring  to  figure  2,  it  seemed  likely  to  cut  across  the 
acuity  curves  for  most  of  the  contrasts,  and  it  also  was  representative  of  viewing  through 
electro-optical  aids.  To  reduce  the  data  from  this  test,  then,  requires  that,  for  each  minimum 
contrast  given  by  an  observer,  the  Landolt  C  visual  angle  for  the  same  contrast  and  light  level 
be  tabulated.  Thus,  although  the  raw  data  are  in  terms  of  contrast,  the  final  data  are  in  terms 
of  visual  angle,  and  averages  are  computed  in  terms  of  the  latter.  The  critical  dimension,  x, 
can  then  be  determined  from  the  ratio 

_ x  (in.)  _ _  3  (in.) 

Experimental  Landolt  C  Visual  Angle  (min)  4  (min) 
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4 

PRELIMINARY  RESULTS 

The  results  presented  in  this  section  are  given  for  the  purpose  of  illustration  and  do  not 
necessarily  represent  normative  data. 

Figure  8  compares  the  averages  for  postadaptation  acuity  for  11  young  male  subjects  at 
UM  with  a  composite  of  the  data  in  references  6-8.  (After  obtaining  these  results,  it  was  dis¬ 
covered  that  the  actual  contrasts  of  the  slides  used  differed  from  the  nominal  values  given  in 
section  3.4;  the  data  in  figure  3  were  then  used  to  generate  the  composite  curves  for  the  appro¬ 
priate  contrast  values.)  Since  the  "populations"  involved  were  different,  there  was  no  a  priori 
reason  to  expect  the  UM  curves  tu  match  the  composite  curvf*.  Nevertheless,  the  agreement 
seems  remarkably  good,  except  at  5.5  x  10  mL  and  for  the  lower  contrasts.  With  regard  to 
the  former,  the  discrepancies  might  be  due  to  the  lack  of  adequate  data  in  this  range  in  refer¬ 
ence  6.  With  regard  to  the  latter,  it  can  be  demonstrated  that  the  low  contrast  values  for  the 
composite  curves  [6-8]  are  suspect  by  plotting  these  data  in  terms  of  log  modulation  versus 
visual  angle  (in  minutes)  for  various  background  luminances  and  observing  the  scatter  at  low  con 
trasts;  a  similar  plot  for  the  UM  data  shows  much  more  regular  behavior  for  the  curves  at  low 
contrasts.  As  can  be  seen  in  figure  8,  when  fewer  than  11  subjects  were  able  to  respond,  an 
average  was  still  computed  for  those  who  were  able  in  order  to  indicate  possible  trends.  Such 
data  points  are  denoted  in  figures  8-10  by  fractions  indicating  the  number  of  subjects  out  the 
total  who  were  able  to  respond.  Figure  9  shows  logarithmic  averages*  for  postadaptation  acuity 
and  form  recognition  for  10  male  subjects  at  AUB;  the  form-recognition  curve  may  be  com¬ 
pared  with  the  expected  result,  a  constant  4  minutes  of  visual  angle  required  to  see  the  man. 
Figure  10  shows  logarithmic  averages  for  postadaptation  acuity  for  the  UM  and  the  AUB  tests. 
The  same  slides  were  used  at  both  locations,  with  the  exception  of  new  10%  slides  used  at 
AUB,  for  which  no  comparable  UM  results  have  yet  been  obtained.  Neither  the  human -form  nor 
the  1%  slides  were  available  at  UM  in  time  to  be  included  in  its  testing.  Figure  11  shows 
the  results  of  a  dark-adaptation  test  administered  to  one  male  subject  at  UM;  it  is  believed 
that  these  are  representative  of  the  results  which  can  and  should  be  obtained,  although  this  test 
has  proved  to  be  very  problematic  and  a  final  evaluation  of  its  potential  has  yet  to  be  made. 


Logarithmic  averages  are  essentially  based  on  the  numbers  of  the  visual-angle  steps 
used  in  the  tests.  They  are  much  easier  to  compute  than  true  averages  and  usually  do  not 
differ  enough  from  true  averages  to  make  them  necessary  in  preliminary  evaluations  of  the 
data. 
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FIGURE  8.  COMPARISON  OF  THE  PRELIMINARY  UM  POSTADAPTATION- 
ACUITY  TEST  RESULTS  WITH  THE  DATA  IN  REFERENCES  6-8.  The  UM 
data  are  true  arithmetic  averages  rounded  to  the  nearest  visual-angle  step. 
The  data  in  references  6-8  are  Interpolated  from  the  curves  in  figure  3  and 
are  rounded  to  the  nearest  step. 
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FIGURE  9.  PRELIMINARY  AUB  POST  ADAPTATION  AND  HUMAN-FORM- 
RE COGNITION  TEST  RESULTS,  These  data  are  logarithmic  averages 
rounded  to  the  nearest  visual-angle  step. 
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FIGURE  10.  COMPARISON  OF  PRELIMINARY  UM  AND  AUB  POSTADAPTA- 
TION-ACUITY  TEST  RESULTS.  Both  sets  of  data  are  logarithmic  averages 
rounded  to  the  nearest  visual-angle  step. 
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TION  TEST  RESULTS  (For  one  male  subject) 


*'1****»  nunr  irt« 


SAMPLE- SIZE  ESTIMATES 

™S  section  presents  some  estimates  of  the  sample  sizes  needed  to  make  statistically 
meaningful  population  comparisons  with  the  UM  tests.  Strictly  speaking,  these  estimates  were 

~;n‘y  f  *e  P0StadaPtal10''  *""» tests-  b“‘  «"»  also  expected  to  appiy  to  the  form- 
recognition  test  and  possibly  to  the  dark-adaptation  test.  The  average  minimum  visual  angle 

for  each  portion  would  be  the  basis  for  comparison  in  all  the  tests  except  the  dark-adaptation 
test,  for  Which  the  average  times  retired  to  see  various  visual  angles  would  be  compared 
e  basic  factors  that  determine  sample  size  requirements  are  the  minimum  difference  to  be 
detected  and  the  desired  statistical  quality  of  the  comparison.  For  some  fixed  quality  the 
smaller  the  difference  to  be  detected,  the  greater  the  total  number  of  samples  required  and 
conversely.  Specifically,  if  the  samples  were  unequal  in  size,  then  the  total  number  of  sam- 
Ples  (i.e„  the  sum  for  the  two  popuiations)  would  increase  more  rapidly  than  if  the  samples 
were  equal  in  size  (though  both  totals  would  increase).  On  the  other  hand,  the  statistical  quality 
o  a  comparison  could  be  improved  by  increasing  the  minimum  difference  as  well  as  the  sam¬ 
ple  s  zes,  and  conversely.  Since  these  factors  would  not  necessarily  be  the  same  for  each  ap- 
P  ca  on,  the  estimates  cover  a  wide  range  of  possibilities  for  each.  The  estimates  also  cover 

a  wide  range  of  relative  sample  sizes,  since  there  are  many  instances  when  unequal  sizes  may 
be  necessary  and/or  desirable. 

Hie  method  employed  is  given  by  Natrella  [16,  p.  T-16]  to  estimate  "sample  sizes  re¬ 
quired  to  detect  prescribed  differences  between  averages  when  the  sign  of  the  difference  is  not 
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important."  This  method  is  conservative  in  that  it  leads  to  somewhat  higher  estimates  than 
can  be  obtained  when  the  sign  of  the  difference  is  important,  as  may  well  be  the  case  for  some 
applications.  It  assumes  that  the  distributions  for  the  population  parameters  involved  are 
normal  and  that  the  true  standard  deviation  j  and  true  means  of  these  distributions  are  known. 
An  attractive  feature  of  the  method  is  that  it  provides  an  analytic  expression  for  sample  size 
which  makes  evident  which  of  the  parameters  are  important. 

If  the  estimated  number  of  samples  needed  for  populations  x  and  y  is  denoted  by  n  and 
n  ,  then  n  and  n  may  be  expressed  as 

y  x  y 

_  <zl-a/2  +zl-/3)2 

nx= - T - —  (1) 

d 

and 


n 


y 


(2) 


where  C  2  1,  so  that  ny  s  n^.  The  numerator  of  (1)  effectively  defines  the  statistical  quality 
of  the  comparison.  The  left-hand  term  depends  on  a,  the  level  of  significance  (i.e.,  the  proba¬ 
bility  of  concluding  from  a  random  sampling  that  the  absolute  difference  between  the  true  popu¬ 
lation  means,  I Mx  -  My  I,  exceeds  some  value  when  in  fact  it  does  not — this  is  also  referred 
to  as  the  probability  of  making  an  "error  of  the  first  kind,"  or  the  "false  alarm"  probability). 
The  right-hand  term  depends  on  1  -  /3,  the  "power"  of  the  estimate  (i.e.,  the  probability  of  con¬ 
cluding  that  I  mx  -  /iy  i  exceeds  some  value  when  it  really  does — (3  represents  the  probability  of 
making  an  "error  of  the  second  kind,"  or  of  concluding  that  I Mx  -  M  i  does  not  exceed  some 
value  when  it  really  does).  Both  the  left-hand  and  the  right-hand  terms  are  of  the  form  z 

p’ 

the  values  of  which  are  tabulated  by  Natrella  [16,  p.  T-3]  for  various  values  of  p. 


The  denominator  of  (1)  is  a  normalized  measure  of 


i.e., 


(3) 


where  cr.  is  the  tvue  standard  deviation  of  population  i.  Combining  (1)  and  (2)  yields 


n  = 
x 


<zl-a/2  +  z 


,  J2(o2  +  C<J2) 
1-/3  \  x  y / 


I  M_ 


(4) 


Equation  4  focuses  attention  on  six  parameters  of  importance:  a,  1-/3,  the  cr's,  C,  and  Im  - 
i,  the  difference  regarded  as  of  practical  significance.  The  lower  the  value  of  a  (i.e.,  the 
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lower  the  false-alarm  probability),  the  higher  the  value  of  z1_a/2  and  thus  the  higher  the 
values  of  nx  and  ny.  The  higher  the  value  of  1  -  fi  (i.e.,  the  lower  the  probability  of  an  error  of 
the  second  kind),  the  higher  the  value  of  and  thus  the  higher  the  values  of  n  and  n  .  Sim¬ 
ilarly,  the  higher  the  value  of  C  or  of  the  a ’s,  the  higher  the  values  of  nx  and  n  .  Finally,  the 

smaller  the  value  of  |/x  -  u  I  one  is  willing  to  ignore,  the  greater  the  Values  of  n  and  n 

x  y* 

From  certain  theoretical  considerations  and  an  analysis  of  some  UM  postadaptation  acuity 
data,  it  may  conservatively  be  assumed  that 


a . 

1 


(5) 


Taking  the  worst-case  condition  expressed  by  (5),  namely  equality,  permits  making  a  substitu¬ 
tion  for  the  a 's  in  (4).  Inspecting  the  result  suggests  still  another  substitution  to  eliminate  the 
M's: 


My=MMx 


where  M  >  0,  but  M  /  1,  so  that  My  >  Mx-  The  result  of  making  both  substitutions  in  (4)  is 


(6) 


n 


x 


(zl-a/2 


)2  1  +  CM2 
4  1 1  -  Ml2 


(7) 


The  closer  M  is  to  unity  (i.e.,  the  smaller  the  difference  between  the  true  means),  the  larger 

are  the  values  of  n  and  n  . 

x  y 

Figure  12  is  a  graph  of  the  estimated  sample  sizes,  nx  and  n  ,  versus  their  ratio,  C  = 
nx/ny’  for  various  values  of  M  =  My/ Mx*  and  for  a  =  0.05  and  1  =  0.90.  Ideally,  one  would 

choose  values  of  a  and  I  -  0  which  were  derived  from  an  analysis  of  the  rewards  and  penalties 
involved  in  the  situation.  lacking  such  information,  the  values  selected  for  figure  12  were 
chosen  simply  in  a  traditional  ad  hoc  manner.  Nevertheless,  other  values  may  be  more  appro¬ 
priate;  figure  13  shows  multiplication  factors  which  may  be  used  to  correct  the  n  values  in 
figure  12  for  certain  other  common  values  of  a  and  a  range  of  1  -  0.  From  figure  12,  it  may 
be  seen  that  in  the  case  of  unequal  sample  sizes,  a  slight  increase  in  the  size  of  the  smaller 
sample,  ny,  may  result  in  a  very  large  decrease  in  the  size  of  the  larger  sample,  n  ,  and  in 
the  total  number  of  subjects,  ny  +  nx<  This  fact  may  be  quite  useful  in  planning  test* strategies 
and  should  be  kept  in  mind  when  dealing  with  unequal  sample  sizes. 


*The  values  of  n  needed  for  the  case  M  =  l/Q  are  actually  slightly 
Q,  but  the  difference  is  not  important  for  the  purposes  at  hand. 


smaller  than  for  M  = 
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FIGURE  13.  MULTIPLICATION  FACTORS  FOR  CHANGING  THE  SAMPLE-SIZE 
ESTIMATES  IN  FIGURE  12.  a  =  significance  level,  or  false-alarm  probability. 
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OTHER  APPLICATIONS  OF  THE  TFSTS 

Whereas  the  preceding  sections  have  been  mostly  devoted  to  explaining  the  interrelationships 
between  the  tests  and  the  night  vision  aids  application,  it  now  seems  appropriate  to  conclude  the 
discussion  with  a  few  brief  remarks  on  some  other  possible  applications  of  the  tests  and  of  the 
ideas  involved  therein. 

In  this  vein,  it  must  first  be  noted  that,  with  regard  to  the  UM-AUB  study,  a  native  U.  S.- 
vs. -native  Middle  East  population  comparison  is  expected  to  be  only  one  (small)  part  of  its  re¬ 
sults.  Besides  establishing  an  apparently  unprecedented  amount  of  vision  test  data  on  a  native 
Middle  Eastern  population  (from  which  intrinsically  valuable  norms  will  be  established),  com¬ 
parative  data  will  also  be  acquired  at  AUB  on  nonnative  but  resident  Middle  Easterners  in  an 
effort  to  pin  down  any  influence  of  the  Middle  East  "environment."  As  a  somewhat  related  effort, 
appropriate  "characteristics"  will  be  noted  for  each  subject  to  enable  studying  the  possible  in¬ 
fluence  of  such  factors  as  smoking,  diet,  the  wearing  of  sun  glasses  (on  night  vision  and  dark 
adaptation),  etc.  Finally,  partly  to  obtain  an  increased  understanding  of  the  tests  and  partly  to 
explore  their  potential  as  a  diagnostic  tool,  a  small  number  of  subjects  with  certain  known  visual 
deficiencies  will  also  be  examined  at  AUB  and  their  results  compared  with  the  norms  obtained 
there. 

In  addition  to  studies  of  the  above  type,  the  tests  could  also  be  used  to  screen  individuals, 
i.e.,  to  select  individuals  who  were  visually  well  suited  for  some  task  from  those  who  were  not. 
Indeed,  it  is  the  latter  which  would  seem  to  account  for  the  greatest  usage  of  instruments  like  the 
Ortho-rater;  though  again,  the  tests  involved  are  typically  nowhere  near  as  comprehensive  as 
those  which  have  been  described  above.  Nevertheless,  with  regard  to  the  "in  between”  approach 
represented  by  the  previously  mentioned  ANST-I*,  it  would  be  possible  to  reduce  the  number  of 
contrasts,  and  light  levels  discussed  above  so  that  some  particular  range  of  interest  could  be 
covered.  (Of  course,  different  targets  might  also  be  used). 

Finally,  regardless  of  the  instrumentation  used,  it  is  believed  that  the  nonsense -form  ap¬ 
proach  to  testing  "recognition"  may  be  valuable  in  establishing  the  critical  dimensions  of  real- 
life  targets  involved  in  other  applications.  Moreover,  if  the  invariance  of  critical  dimensions 
to  changes  in  contrast  and  light  level  holds  as  well  ?s  it  now  appears  to  do  (for  the  man),  then 
such  critical  dimensions  could  be  established  using  only  one  contrast  and  light  level,  a  consider¬ 
able  savings  in  effort. 


♦Army  Night  Seeing  Tester 
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Appendix 

PROCEDURES  USED  FOR  PRODUCING  THE  TEST  SLIDES 

by  J.  Cooper 

The  first  step  involved  in  making  the  Landolt  C  slides  was  to  produce  master  negatives 
from  which  positive  slide  transparencies  co  -T  '<  later  be  made  by  a  contact  printing  process. 
These  negatives  had  to  be  of  the  same  size  as  the  positives  and  had  to  exhibit  minimal  distor¬ 
tion  due  to  lens  aberrations.  They  were  obtained  as  follows.  First,  a  matte  white  vertical 
surface  was  placed  at  one  end  of  the  photographic  studio  to  define  an  object  plane  and  to  serve 
as  a  background  against  which  black  cardboard  Landolt  C’s  would  ultimately  be  placed.  Next, 
a  carefully  measured  rectangle  of  black  thread  was  formed  on  this  surface.  A  4  x  5  view 
camera  with  a  process  lens  was  then  placed  on  a  heavy  tripod  which  in  turn  was  set  at  an 
appropriate  predetermined  distance  from  the  object  plane.*  The  camera  position  was  care¬ 
fully  measured  to  ensure  that  it  was  on  a  line  perpendicular  to  the  centerline  of  the  object 
plane,  and  the  camera  was  carefully  leveled.  A  final  check  to  ensure  parallelism  between  the 
object  and  image  plane  was  made  by  photographing  the  rectangle  on  the  object  plane.  After 
processing,  the  negative  was  measured  on  a  comparator.  Adjustments  were  made  to  the  cam¬ 
era  back  until  parallelism  was  obtained.  Also,  a  matched  set  of  film  holders  was  selected  for 
use  by  employing  a  micrometer  to  sort  out  those  with  film  planes  at  an  identical  "depth." 

Two  banks  of  lights  were  used  to  illuminate  the  object  plane;  these  were  carefully  adjusted 
to  that  the  illumination  on  the  object  plane  was  even  within  the  reading  accuracy  of  a  sensitive 
CdS  light  meter.  Then,  from  the  set  of  black  cardboard  C’s  which  had  been  provided  for  the 
layouts,  the  largest  C  was  selected,  taped  to  the  object  plane,  and  photographed.  Cronar  base 
film  (COS  4)  was  used  for  this  purpose  because  of  its  high  dimensional  stability.  Also  a  stan¬ 
dardized  film  processing  procedure  was  adopted  to  avoid  size  changes  due  to  processing  varia¬ 
tion.  After  processing  and  stabilization  to  room  conditions,  the  negative  depicting  the  large  C 
was  measured  with  a  comparator  to  ascertain  the  diameter  of  the  C.  Camera  positions  were 
changed  and  realignment  procedures  repeated  until  this  diameter  was  within  tolerance.  At 
this  point,  the  camera,  tripod,  lights,  and  object  plane  were  locked  down  to  prevent  any  acci¬ 
dental  shift  in  position.  Also,  register  marks  were  fastened  to  the  object  plane  for  use  in 
final  assembly  of  the  stereo  slides. 


*The  distance  was  set  so  as  to  produce  negatives  (and  thus  slide  positives)  that  would  be 
of  a  proper  size  for  use  in  the  Ortho-rater.  Consistent  with  this,  the  focal  length  of  the  lens 
used  was  selected  such  that  the  angle  of  the  image  formed  by  the  lens  was  less  than  1/6  the 
normal  angle  of  the  lens.  This  was  done  in  .ordefto  produce  images  essentially  without  geo¬ 
metric  distortion.  \ 
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As  needed  for  each  slide,  the  C's  were  fastened  to  the  object  plane  in  the  appropriate  pat¬ 
terns,  and,  to  make  stereo  slides,  two  negatives  were  made  of  each  pattern.  These  were  pro¬ 
cessed  together,  following  the  standardized  procedure,  using  fresh  developer  for  each  pair. 
Then,  by  means  of  an  alignment  "jig"  specially  designed  for  the  purpose,  they  were  spliced 
together  with  the  proper  separation  to  form  stereo  masters.  Since  it  seemed  desirable  to 
i.andle  these  masters  as  little  as  possible,  duplicate  negatives  were  then  printed  for  use  as 
working  negatives.  The  latter  were  also  checked  to  be  sure  there  was  no  deviation  from  cor¬ 
rect  image  size.  (The  masters  and  working  negatives  were  all  black-on-white,  regardless  of 
the  contrasts  of  the  slides  for  which  they  were  intended.) 

To  make  the  positive  transparencies  needed  for  the  slides,  Dupont  Aerial  Duplicating  Film 
was  used.  The  positives  were  then  made  from  the  working  negatives  after  preliminary  tests 
were  made  to  determine  approximate  exposure  times  for  the  required  contrasts.  A  procedure 
was  instituted  giving  a  film  gamma  close  to  that  which  would  result  if  the  development  were 
indefinitely  prolonged;  this  involved  development  in  fresh  Dupont  53-D  developer  for  3  1/2  min 
at  68°F  with  carefully  controlled  agitation.  During  preliminary  testing  on  the  positives,  it  was 
found  that  stray  light  was  falling  on  the  printing  area.  To  eliminate  this  light,  the  point  light- 
source  used  in  the  contact  printing  operation  was  hooded  with  a  2-ft-long  black  cylinder  to 
prevent  its  light  from  reflecting  off  the  ceiling,  floor,  and  walls  of  the  darkroom.  In  addition, 
this  area  itself  had  to  be  "tented"  in  black  nonreflecting  material.  Even  the  photographer  had 
to  wear  dark  clothes  and  stand  a  good  distance  away  from  the  printing  area  during  exposure. 
Failure  to  exercise  these  precautions  caused  variations  in  density  of  as  much  as  0.02  from  one 
side  of  the  positives  to  the  other. 

For  the  low-contrast  slides  (i.e.,  those  of  1%  and  2%  modulation),  a  method  of  outlining 
the  overall  slides  was  needed,  since  the  C's  were  barely  visible  and  therefore  could  not  be 
used  for  proper  alignment.  For  this  purpose,  a  combination  mask  and  film  holder  was  made 
to  slip  in  the  v.cuum  frame  used  in  making  the  contact  prints.  This  permitted  the  print  area 
around  the  slides  to  be  heavily  exposed,  thus  ultimately  making  the  overall  outline  of  the 
slides  visible.  By  removing  the  mask,  the  slide  itself  could  then  be  exposed  to  the  required 
density.  Two  slides  (of  the  same  contrast)  could  be  printed  together  this  way. 

In  addition  to  the  precautions  against  stray  light,  a  constant  voltage  transformer  was  used 
on  both  the  point  light-source  and  the  exposure  timer  to  guard  against  deviations  in  exposure 
(and  thus  contrast)  due  to  line  voltage  fluctuations.  Tlie  line  voltage  was  monitored  with  a 
meter  and  no  exposure  was  made  if  the  meter  showed  any  deviation  from  normal. 

With  these  controls,  preliminary  exposures  were  made  and  the  positives  given  standard 
processing  and  dryed.  After  stabilization,  the  densities  were  read  with  a  Welch  Densichron. 
(This  was  used  throughout  and  was  checked  against  a  standard  before  and  after  each  density 
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reading.)  Based  on  the  density  readings,  the  exposure  was  varied  to  make  new  test  positives 
until  the  contrasts  of  these  came  within  tolerance.  After  the  proper  exposure  was  established 
for  any  one  contrast,  all  positives  .of  that  contrast  were  so  exposed  and  processed,  each  in 
fresn  developer,  and  the  contrasts  checked.  Since  two  complete  sets  of  slides  were  required, 
each  positive  was  duplicated  on  the  same  sheet  of  material  to  ensure  that  the  sets  would  be 
identical.  Whenever  the  C's  were  too  small  to  be  read  in  the  densitometer,  a  patch  of  negative 
material  of  the  same  density  as  the  clear  area  of  the  working  negatives  was  mounted  between 
the  slide  areas,  and  the  positive  densities  formed  through  it  were  read  and  assumed  to  be 
identical  to  that  of  the  C's.  To  ensure  that  the  density  of  the  patch  was  exactly  the  same  as 
that  of  the  clear  area  of  the  working  negatives,  the  film  used  to  make  the  patch  was  given  an 
exposure  identical  to  that  given  a  card  covered  with  the  same  black  paint  used  for  the  C’s  and 
was  processed  in  the  same  way  as  the  working  negatives.  Further,  the  films  used  for  both  the 
working  negatives  and  the  patch  were  from  the  same  emulsion  batch. 


It  was  important  to  be  precise  in  all  stages  of  manufacture  of  these  slides.  Even  the  wash¬ 


ing  time  for  the  positives  had  an  effect  on  density.  A  set  of  slides  with  too  high  a  density  was 
rewashed  for  20  min;  this  reduced  the  density  by  0.04  and  brought  them  to  the  required  reading. 
Final  preparation  of  the  slides  simply  involved  sandwiching  the  appropriately  trimmed  positives 
between  two  carefully  cleaned  sheets  of  cover  glass  and  binding  the  edges  with  tape.  Though  a 

different  camera  setup  was  used  in  producing  the  human-form-recognition  slides,  the  proce¬ 
dures  were  otherwise  the  same. 
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